[4][5] The church complex, which includes a parish house – now referred to as the "South Wing"[4] – on West 11th Street and a church house on West 12th Street designed by Edgar Tafel, is located within the Greenwich Village Historic District.

[10] Later, during the early 19th century, the church took a more conservative approach, being aligned with the "Old School", centered on Princeton Theological Seminary, which disapproved of the revival movement, and did not openly oppose slavery.

Fosdick's sermon would eventually cost him his job and he would go on to pastor an American Baptist congregation and then, the famed Riverside Church.

[7] Beginning in 1893, the same year that McKim, Mead and White began construction of the church's south transept,[4] the church installed stained glass windows by Louis Comfort Tiffany, Francis Lathrop, D. Maitland Armstrong and Charles Lamb.

[4] The church complex, which is surrounded by a fence, partly of wood and partly of cast-iron,[4] also includes a stone Gothic Revival parish house or "South Wing" at 7 West 11th Street,[16] which includes the Alexander Chapel added in 1937, with stained glass windows on Scottish themes.

[17] On the north side of the complex is the Church House at 12 West 12th Street, the Mellin Macnab Building,[17] built in 1958–60, and designed by Edgar Tafel,[3] who apprenticed under Frank Lloyd Wright.

The smaller of the two instruments, known as the Rees Jones Memorial Pipe Organ, is in the Georgian English style and was installed in Alexander Chapel in 2003.