Patterson started his college football playing career at Contra Costa College from 1978 to 1980 as a defensive lineman. He then transferred to the University of Montana in 1981 before suffering a career-ending knee injury. Patterson graduated from Montana in 1983 with a bachelor's degree in secondary education.
