It was constructed 1883-1885 in an overall L-shape, with a facade of brown Longmeadow sandstone, a tower rising from the L's inner corner, and a heavily arched entry porch set within the L's short arm.

The main library room is 50 x 36 feet and finished in elaborately carved white oak with a high, vaulted ceiling.

[3] In 1896 two additions were made to the building, designed by Richardson's successor firm, Shepley, Rutan & Coolidge.

One gable-roofed wing extends the building to the rear, along Park Street, following the same general lines of the existing structure.

[2][3] The interior of the library's historic wing provided the setting for a scene in the movie Ted 2, starring Mark Wahlberg and Amanda Seyfried.