Under various names, the church building has been used by three Christian denominations, including Episcopalians, Dutch Reformed, and Catholics.

The church was built from sandstone from Nova Scotia in 1870 to a design by the architectural firm of Hubert & Pirsson.

Architectural historian and New York Times journalist Christopher Gray wrote that "The Gothic-style building has the air of a picturesque English country church, with a plot of green in front and a square tower rising in front of the sanctuary.

According to Andrew S. Dolkart, an architectural historian specializing in church design, the building is closely modeled after Edward Buckton Lamb's Church of St. Martin's, Gospel Oak, London (see Gospel Oak), built in 1865.

'The chamfered corners, the varying planes of the façade, the asymmetrical pinnacle at the top of the tower.