Built in 1864, it is a significant example of early Italianate ecclesiastical architecture in the state.
The church was added to the National Register of Historic Places in 2001.
A three-story tower projects from the center of the front facade, topped by a distinctive multistage copper-clad steeple.
The building's Italianate features include brackets in the gable and eaves, and round-headed windows on the second level.
They first met in rented space, before building their own edifice at Main and Church Streets in 1845.