The church building was designed by the architectural firm of William Appleton Potter (1842–1909).

The church is a double-height brick and stone structure over a basement.

It has a pitched slate roof, and is notable in having all of its stained glass in the nave and clerestory designed by Louis Comfort Tiffany and manufactured by his Tiffany Studios, which was also responsible for the ceramic mosaic behind the altar, the sanctuary lamps, the pews, and the painted decorative organ frontal pipes in the front of the sanctuary.

The nave and clerestory windows, which feature St. Paul preaching at Athens and Christ returning in glory with angels, breaking swords beneath them and ushering in a reign of peace.

[2] The Tiffany windows restoration campaign, titled "Shining God's Light - the Tiffany Windows Project", has been ongoing since 2007, raising funds for a one-million-dollar complete restoration of all the Tiffany windows.