Palmer died on 8 November 1723. By his first wife he had three sons and four daughters of whom only three daughters survived him. He had one daughter by his third wife. He left his widow a life interest in the Wingham estate, which, after her death, was to pass to his son, Herbert. The baronetcy passed to his cousin Charles.
