In June 1856, Smith married Miss Harriet E. Nutting of Amherst, Massachusetts. She had been a teacher in Ohio and other places. She was also described as a scholar. Harriet had poor health that prevented the Smiths from going to Minnesota for the American Home Missionary Society. She was living at the time of his death.
