Rutherford attended the Chaminade College Preparatory School in West Hills, California. As a freshman, Rutherford committed to play college baseball at University of California, Los Angeles (UCLA). As a junior, he hit .435 with four home runs. In August 2015, he played in the Under Armour All-America Game at Wrigley Field. As a senior, he batted .577.
