The district includes the Potter–Allison House, a nineteenth-century wood barn, and a variety of outbuildings, including a hog barn, equipment buildings, a corn crib, a stone slaughterhouse, and a springhouse.

Also located on the property are the remains of milling and tanning operations.

The Georgian-style house was built circa 1817, with a Victorian section added sometime during the 1850s.

The property was originally owned and developed by General James Potter (1729–1789), who built a log cabin and grist mill.

The property was acquired by the locally prominent Allison family in 1849.