In 1799, Martin, having lost the support of North Carolina Federalists, was voted out of the Senate. He returned to the North Carolina General Assembly in 1804, and in 1805 again became Speaker of the North Carolina Senate. He died in 1807.
