After a fire in 1509, the damaged castle was rebuilt. Another fire on 23 June 1669 destroyed the town of Reifferscheid and its castle completely. On the remains of the old building substance, its owner had a representative schloss built in the Baroque style, and on the foundations of the old castle walls the houses of the former Burgfreiheit were rebuilt.
