Verney was the daughter of Lady Sarah Elizabeth Amherst and her husband John Hay-Williams, 2nd Baronet Williams of Bodelwyddan. On the death of her father in 1859, she inherited his house "Rhianfa", on Anglesey, which she retained as a family home.
