For decades after his death, Haynes was remembered primarily for his speaking ability. T.A.R. Nelson described him as the "Cicero of America," and author Frank Richardson (1831–1912) called him a "silver-tongued orator." During the Civil War, Johnson's Depot, near Haynes's farm, was renamed "Haynesville" in his honor. After the war, the town reverted to its original name, and incorporated as Johnson City shortly afterward. Prior to his move to Memphis, Haynes sold his farm, the Tipton-Haynes Place, to his brother-in-law, Lawson Gifford. In 1945, Gifford's grandson sold the farm to the Tennessee Historical Commission. The farm is now managed as the Tipton-Haynes State Historic Site.
