Born in Ann Arbor, Michigan, Patterson was the son of Ed Curtis. He grew up in a poor family in the Northern part of Ann Arbor. His biological parents were not married, and he was raised by his mother and step-father. His step-father hauled coal for a living and struggled with alcoholism. He had nine siblings on the Patterson side of the family whom he lived with, in addition to 10 other siblings from his biological father. Willis is a graduate of Ann Arbor High School, the University of Michigan (BM in 1958 and MM in 1959), and Wayne State University (Doctorate of Music). A Fulbright Scholarship enabled him to pursue studies in opera and lieder in Germany for a year and a half, and he also attended classes in opera at the Manhattan School of Music. Prior to joining the voice faculty at the University of Michigan in 1968, Willis served on the music faculties of Virginia State College and Southern University. From 1969–1975 he was the music director of the University of Michigan Men's Glee Club.
