In the 1960s, a fire partially destroyed the Ferguson Hotel. As a result, Gurnett Ferguson sold to another hotel business. A second Brown Building located on Shrewsbury Street was built and completed in 1971, with work on the building being done entirely by African-American businesses, contractors, and sub-contractors. For a few years before his death in 1974, Brown maintained an office in the new building, along with his son and daughter. Other offices have included a barber shop, doctor's office, real estate office, and some government offices.
