Stewart was born in Asheville, North Carolina. His alias Backwards Sam Firk was an homage to the musician John Fahey, who had used the pseudonym Blind Thomas for some of his recordings. Stewart also explained that "My dad used to call me Backwards Sam because my initials are MAS."
