Founded in 1839, its building, designed by English architect Henry Vaughan, is an important example of his work, and was listed on the National Register of Historic Places in 1984.

In 1901, the church bought the William Hale House, which was also later listed on the National Register of Historic Places.

It is basically rectangular in footprint, with a square tower rising at the northwest corner, and slightly projecting transepts.

The interior retains original woodwork and plaster; its gas chandeliers have been replaced by electric lighting.

[4] At the back (south side), it is joined by a modern parish hall to the William Hale House, which stands just to its east.