Southwell came up through the Grimsby Town youth system and at 17 made his first senior appearance in the 2010–11 season. Southwell remained with the Mariners for three years, but despite regular substitute appearances, he was only given 10 starting appearances. During this period he also had a short loan in the Conference North at Harrogate Town, scoring 1 in 3 appearances.
