The parish at first met at the Manor Reformed Church on Kingsbridge Road, then on June 11, 1854 acquired an old schoolhouse for use.

[2] Bishop Horatio Potter laid the cornerstone of the present building on May 28, 1864, and the church was consecrated by the same on All Saints' Day, November 1, 1865.

[4] It is a "native stone" building with brownstone trim in the Gothic Revival style.

[4] The stone parish house, located on Jerome Avenue, was built 1891-1892 to the designs by Henry Franklin Kilburn.

The parish also operated an apartment building on its property, built to relieve the housing shortage after World War I and as a business venture to raise revenue for expanding the church and parish house.