The last of the families to own the castle was the Woelmont family, in the mid-19th century. The last lord of Ammersoyen was Arthuer de Woelmont, who bought the castle in 1856. Over the course of the next 17 years, he eventually sold all of the possessions of the castle, and in 1873 he sold the castle to the Roman Catholic Church in Ammerzoden.
