The building is situated on a hill, due south of Clove Brook, a creek from which it derives its common name.

It was built in 1829 and added to the National Register of Historic Places on September 23, 1982 for its significance in architecture and religion.

The Gothic windows were included as ornament to distinguish the structure as a place of worship.

The National Register of Historic Places describes the church as a "simple 1 1/2 story rectangular clapboarded frame structure with a four bayside facade and a three bay gable front on a cut stone foundation.

Pot-bellied stoves and a Victorian chandelier were additions during the churches centennial.