Helen was born on November 4, 1850 in New York City. She was one of the "three handsome Smythe girls" born to Henry A. Smythe and Mary (née Franklin) Smythe. Her father, a merchant, banker and conservative Union Republican, was a Collector of Customs in New York from 1866 to 1869 (alongside Herman Melville) under President Andrew Johnson, who is most well known for his impeachment in March 1867, following accusations of corruption. He was later nominated for the position of U.S. Ambassador to Russia by President Ulysses S. Grant in 1869, but was tabled by the Senate and did not receive his commission (Andrew Gregg Curtin was appointed instead). Helen's sister Fannie Smythe, was the second wife of Edward Padelford, who had a home (now known as Roosevelt Hall), in Skaneateles, New York.
