Officially founded in 1827, with the current building consecrated in 1911,[1] it is notable for its gothic-revival architecture, medieval interior and fine stained glass.

Its first services were held in the home of George Macculloch –a prominent town member and builder of the Morris Canal whose mansion stands near the church.

The current building was designed to include the styles and art of early and medieval Christian liturgy to engage modern worshipers in the Eucharist in this same way.

It also incorporates elements from other Christian periods including chancel mosaics, a baptistry, and the Siena-marble altar each in the Byzantine style, and a Spanish-baroque rood screen.

These include St. Mark's Basking Ridge, St. John's Dover, and Grace Episcopal Church in Madison, New Jersey —all built in the 1850s while Dr. Rankin was rector of St.