Allen was born in Gilfach Goch, Glamorgan and as a schoolboy attracted the attention of several football League clubs, including Manchester United, where he had an unsuccessful trial. On leaving school, he was employed in the Trave Colliery before signing for Swansea Town when he was 16. He had not broken into Swansea's first team before his career was interrupted by the Second World War.
