Élie was a friend of Prince Aly Khan and Gianni Agnelli. In 1954, when Liliane was out of town, Élie was introduced to divorcée Pamela Churchill (later Pamela Harriman). According to Élie, "She was sweet, charming and pretty. I wanted to go to bed with her and I did." Nevertheless, Liliane quickly saw off her rival. When the Duke of Windsor asked her: "Which Rothschild is the lover of Pamela Churchill?' she replied: "My husband, Sir". This remark undermined Pamela as much as any other retributive strikes and presently the affair receded. His nephew Éric de Rothschild, son of Alain, took over at Château Lafite-Rothschild in 1974.
