Prinz zur Lippe-Weißenfeld never married or had children. In January 1941 he became acquainted with Hannelore Ide, nicknamed Idelein. She was a secretary for a Luftgau. The two shared a close relationship and spent as much time together as the war permitted, listening to music and sailing on the IJsselmeer until his death in 1944.
