The house was built as a two-story structure for John Rutledge in 1763, by which time he had already established a successful law practice. Rutledge played a significant role in organizing the Patriot forces of South Carolina during the American Revolutionary War, serving as the state's executive for much of the conflict. He also attended the Constitutional Convention of 1787, and is a signer of the United States Constitution. The house passed out of his family, and was enlarged by the addition of the third story in 1853 by Thomas M. Gadsden. The house served as a law office in the 20th century.
