The current church building was built in 1830, constructed of field stone in the Gothic Revival style.

The church steeple is capped with four pinnacles and contains the 1804 bell from the third meetinghouse.

[2] The First Parish was established in 1637 by a group of Puritans from Devonshire, England, led by Elizabeth Pole, by way of Dorchester, Massachusetts.

The first two meetinghouses built on Church Green also served as the location for civic and political business until 1746.

The third church was built in 1794, and was designed by architect Charles Bulfinch.