Heathcoat-Amory married Henrietta Mary Unwin in 1863. They had nine children (five sons and four daughters), of whom six reached adulthood. Derick Heathcoat-Amory, 1st Viscount Amory, was their grandson while David Heathcoat-Amory is their great-grandson. Heathcoat-Amory died in May 1914, aged 85, and was succeeded in the baronetcy by his second but eldest surviving son Ian. Lady Heathcoat-Amory died in November 1923.
