It is believed that the farmhouse was built in 1845–1846 as a wedding gift for Thomas Avery and Elizabeth Griswold.

It is believed, through a newspaper discovered in the wall and other records that the house was built in 1845-1846 as a wedding gift for Thomas Avery and Elizabeth Griswold.

[1] Smith died in 1951 and his widow and Frank Harris, shortly before his death, sold the house and the 103 acres (41.6 hectares) of land to the Town of East Lyme for $34,000.

The front facade has a typical three-bay design with the entrance supported by pilasters with squared, recessed panels for the main door frame and frieze.

The foundation is made of locally sourced granite slabs and includes a full basement.

The square gable windows feature small panes in wooden muntins.

At the time of its National Historic Register of Places nomination, the gable roof was covered with cedar shingles as part of the restoration effort.

In adherence to fire code standards, the rear chimney was rebuilt, yet "accurately reproduces the large bake oven.

The Town of East Lyme considered destroying the house for municipal purposes, but citizens successfully petitioned and restored it.

[3] The restoration the addition of murals painted by the Connecticut Society of Decorative Painters in the style of Rufus Porter.