In 1961, when The Sword and the Flute was shown in New York City, the Jaffreys encouraged Ismail Merchant to attend the screening, where he met Ivory for the first time. They subsequently met regularly at the Jaffreys' dinners and cemented their relationship into a lifetime partnership, both personal and professional. The Jaffreys planned to go back to India, start a travelling company and tour with it. They would often discuss this idea with James Ivory and started writing a script in his brownstone on East 64th Street.
