Born in Swindon, England, Mills started his football career at Aston Villa's academy before opting to move to Southampton in August 2006. At Southampton, alongside his brother Matthew, he progressed through the academy and reserve sides before being promoted to the first team ahead of the 2008–09 season.
