Doughty married fellow Conservative Party member Adelaide Baillieu Shackell (1908–1986), on 29 July 1931 at St Margaret's, Westminster. They had a son and a daughter. She served from 1967–1968 as Chairperson of the National Union of Conservative and Unionist Associations. In 1978 she was named President. She was appointed a Dame in 1971.
