The congregation, founded in 1840, occupied an 1886 Gothic Revival stone building designed by Richard M. Upjohn and listed on the National Register of Historic Places in 1984 for its architecture.

The congregation was established in 1840, and first occupied a small wooden church that located just north of the current site of the Lithgow Library.

[6] The church occupies a lot between Summer and Pleasant Streets a short way west of downtown Augusta.

It is built out of quarry-faced granite, with a gable-roofed main section oriented east-west and two south-facing gabled projections.

The western of the two projections has a tall square tower, with buttressed corners, belfry, and pyramidal roof topped by a cross.