By 1990 the Kruithuis had become too small due to the growth of the collection, and the professionalization of the organization. In 1994 the municipality of 's-Hertogenbosch then decided to expand the museum at the place where it was located. A new building was designed, which would integrate the Kruithuis. While waiting for completion, the museum and art loan moved to the Hekellaan, somewhat to the south. Many protests then succeeded in cancelling the design by architect Bořek Šípek. In 2002 the municipal government decided to cancel the plans at the Kruithuis, and to look for a location in the city center. This caused that from 2003 to 2013 the museum was located in an old commercial building in the Palace Quarter southwest of the Railway station. The Foundation for Visual Arts Loans did not move to the Palace Quarter, but moved to a building on Hinthamerstraat.
