Dolvin was born in 1912 in Richland, Georgia as the youngest of Mary Ida Nicholson (1871–1951) and James Jackson Gordy's (1863–1948) nine children. Her sister Lillian Gordy Carter was the mother of Jimmy Carter, the 39th President of the United States.
