Sir Marteine Lloyd died in 1933, and Lady Lloyd attempted to let the house, which ended up housing illegal aliens. On Lady Lloyd's death in 1937, the house and grounds were sold. The sale of land close to the mansion for forestry work doomed the house. After housing a Jewish boarding school, Aryeh House School, in the Second World War, and aliens thereafter, the house, then known as Bronwydd Castle, was stripped. Substantial parts of the house remained roofed into the 1980s. The round tower fell in the early years of the 21st century, and much of the house has disappeared.
