Rylands married twice. He had three sons by his second wife Caroline Reynolds, whom he married in 1861. His eldest son, the author L. Gordon Rylands, published an edition of his letters."The Man of Philanthropy, Politics and Clogs". Warrington Museum & Art Gallery. A grandson was the academic Dadie Rylands.
