Architectural evidence suggests that this 2+1⁄2-story frame house has at its core a First Period structure that may date to the early 1670s, making it the oldest building in Sherborn.

The main house is a 2+1⁄2-story wood-frame structure, five symmetrically placed bays in width, with a side-gable roof and a large central chimney.

The western portion of the structure, a three-bay two-story section that is one room deep, may have been built around 1670 by Joseph Morse, the son of one of Sherborn's first land grant recipients.

Morse's home is known to have been the site of the community's first religious services, until a proper meeting house was built in the 1680s.

[3] The barn is set northeast of the house and is oriented parallel to the road.