Subsequent to the Texans' 2006 NFL Draft and after the Texans' 2-14 season, Casserly left the organization on June 1, 2006. Casserly sought a job in the National Football League front office, but was passed over for the job. He was succeeded as General Manager by Rick Smith. Casserly's work with the Texans was subjected to much criticism.
