Sherf attended Michigan from 1932 until 1936, majoring in history and playing hockey on the varsity team during all four years. John played hockey at Calumet High School and for the semi-pro Calumet Black Hawks before enrolling at Michigan. He played center at U of M for three seasons. No records are available for 1933–34. John was the leading scorer in the 1934–35 season with 23 goals and 14 assists in 16 games. In 1935–36, he was the leading scorer of the Western Conference with 33 goals and 10 assists in 17 games. That year, Michigan's opponents scored a combined total of only 30 goals. During his senior year Sherf was elected captain of the hockey team and later selected for the prominent senior men's honorary society, Michigauma. The honorary society was based on local American Indian traditions and each inductee was given an Indian name consistent with his college activities in the induction ceremony. Sherf's Michigauma name was "Flashing Feet Sherf", noting his skill as a hockey player.
