Desmonde was married to actress Peggy Duncan (born Peggy Doreen Edwards) from 1930 until her death in 1966. They had a daughter named Jacqueline and a son named Gerald. After World War II, the family settled in London and Jacqueline later married musician Peter Howes, who was the son of actor Bobby Howes and brother of actress Sally Ann Howes.
