Sperry spent his early childhood in Stamford, Connecticut, and New York City. Accompanied by their mother, he and his brother Armstrong briefly attended school in Paris, France. Sperry received additional schooling at the Taft School in Connecticut. He spent a single freshman year at Dartmouth College in New Hampshire.
