In 1889, Smith built a large commercial building at the intersection of Peachtree Street and Forsyth Street. The building, called "The House That Jack Built", was constructed of granite blocks that had proven unusable for street paving purposes and adorned with marble slabs that had different phrases and sayings, including many Biblical verses. When Smith leased the building and property in 1909, he stipulated that the inscribed slabs should be displayed prominently in any future building or structure built on the property. When MARTA built the Peachtree Center station on the property in 1982, they relocated two of the slabs to a fenced-off area near the subway station entrance, where they still lie.
