Axed prison boss breaks his silence