The main focus of the property is a large Federal-style brick house built c. 1800 by Oliver Whiting; it also has an 1846 Gothic Revival barn which predates the establishment of the poor farm.

It is believed that the main house on this property was built soon thereafter; its fine period details, which were uncommon in what was then a largely rural community, were probably the result of design influences brought in from other areas by the Whitings.

Oliver's son David purchased an operation in 1857 that included a daily railroad run to Boston, Massachusetts, carrying fresh milk.

Only foundations of most of these features now survive, since they were dismantled after the poor farm's closure in 1896.

In the early 20th century the property was transformed into a summer estate by the Beebe family.