James was educated at York Place Secondary School, Brighton. At age 13 he went to Taunton's School at Southampton, from where he won an exhibition to the Queen's College, Oxford. He gained a first in Chemistry, and represented the university at chess. He had planned on studying Medicine, but unable to obtain the necessary scholarships, he chose a teaching career.
