McDermott was born in Philadelphia, Pennsylvania, the son of a mailman. He was a good student at West Philadelphia High School, but dropped out before graduation to become a professional golfer. He worked as a caddie at the Aronimink Golf Club, and learned golf from its longtime head professional Walter Reynolds.
