The current building was constructed in 1828 by Boston stonecutter Abner Joy to designs by Alexander Parris.

It was designated a National Historic Landmark on December 30, 1970, for its association with the Adams family, who funded its construction and four members are buried there.

It has a Greek temple front, supported by four monolithic granite columns which may have been the largest set in the United States at the time.

Its original bell was cast by Paul Revere, but was melted down and recast as it was not loud enough to serve as a fire alarm.

The origins of the PBP started in 1972, in the Red Book Store Collective in Cambridge, where it disseminated progressive literature, and advocated for the well being of prisoners.