The 2+1⁄2-story gambrel-roofed wood-frame structure was designed by Moses Johnson and built in 1793–94 at the Shaker village in Enfield, New Hampshire.

[2] The Shakers stopped using the building in 1893, and sold it in 1902 to sculptors Louis St. Gaudens and Annetta Johnson Saint-Gaudens.

The St. Gaudens had the building disassembled and moved to its present location, making a number of alterations to it in the process.

Due to rot in some framing members, the building was shortened by 8 feet (2.4 m), and a porch was cut into one side.

One of the two main entrance doors was relocated to the side of the building, and dormers were added to enlarge the attic space.