The parish was incorporated in 1830, and in 1841 it purchased the site of its present church at 26 Washington Street.

Architect Richard Upjohn drew up plans for the church in English Gothic style, and construction began in 1842.

[2] In 1886, Mrs. Rockwell Putnam, widow of the owner of the Grand Union Hotel in Saratoga Springs, donated money for construction of a tower in memory of her late husband.

Page Brown designed the additions in Norman Romanesque style, and the work was completed in 1887.

[3] A notable feature of the renovation was the addition of Tiffany windows in the front facade.