Joseph R. Sullivan was born on June 20, 1880, in O'Neill, Nebraska. He graduated from high school in O'Neill and later received a law degree from Creighton University in 1908. On November 29, 1909, he married Amy, with whom he had four children with, including John F. Sullivan who served in the Wyoming House of Representatives, and Patrick B. Sullivan, who fathered Governor Mike Sullivan.
