In 1881 he was married to Jane Elizabeth Barbour (1861-1944). Their son Robert Barbour Whyte was killed in the First World War. Their eldest son (Alexander) Frederick Whyte was a journalist and politician who received a knighthood. Their daughter Janet Chance was a feminist author and campaigner for sex education, birth control, and access to abortion.
