Despite a winning record, Collier was fired in January 1962, when he was making $17,500 per year (about $ in dollars). He was replaced a week later by Charlie Bradshaw, an assistant to Bear Bryant at Alabama. Bryant had led the Wildcats to appearances in three major bowl games, but Collier never led the Wildcats to a bowl during his tenure. His best record was in his first year, when the team finished 7–2.
