Built for the city between 1907 and 1909, it was designed by the architect Stephen F. Voorhees (1878–1965) of Eidlitz & McKenzie.

The 3-story, rectangular red brick building has a steeply pitched roof covered with green clay tile.

The former rectory contains the museum and is a 2-story rectangular building in the Tudor Revival style.

[2] The building on Glen Street was used for the court, city hall and later as police headquarters.

In the early decades, the Women's Exchange was located just to the west of the building; the group raised money to provide social services.