Holley played high school football at El Modena High School before attending Orange Coast College for two years. In 2009, he recorded 311 carries for a school-best 1,457 rushing yards. He transferred to Louisiana Tech to play for the Bulldogs in 2010, where he played until 2012. Holley missed games during 2011 due to a season-ending back injury. In his final year with the Bulldogs, he ran for 1,090 yards and 13 touchdowns.
