The museum is housed in the former Improved Order of Red Men fraternal lodge. The three-story brick building or "wigwam" was built in 1904 by the Delaware Tribe No. 43 who occupied the building until 1936. The Fraternal Order of Eagles Brunswick Aerie No. 1136 purchased the building on June 1, 1936 and removed the Native American statue from the entrance. That statue is now on the second floor of the museum. The museum chose the building because it is located less than a block from the Brunswick Line MARC commuter line and four tracks of the CSX mainline.
