Cobham married the Hon. Mary Susan Caroline Cavendish, daughter of William George Cavendish, 2nd Baron Chesham, in 1878. He died in June 1922, aged 79, and was succeeded in his titles by his eldest son John. His second son George William Lyttelton became a classics master at Eton and was the father of the jazz trumpeter Humphrey Lyttelton. Lady Cobham died in 1937.
