The church was built in 1812 in the Federal style and is a three-by-five-bay, heavy timber framed, 38-by-40-foot (12 by 12 m) building sheathed in wood shingles and covered by a gable roof.

[2] The church grounds were the site of a Loyalist fortification that was attacked by Continental Army forces from Connecticut in August 1777.

Prior to this, existed an earlier presbyterian church on the village green, which was later burned down after being struck by lightning.

The burial ground contains the remains of some of the earliest pastors of the church including Nathaniel Brewster (1600–1690), George Phillips (1660–1739) (grandson of Rev.

Also many of the founding families of the area are buried here including the Bayles, Davis, Dickinsons, Floyds.