First Baptist Church's current Gothic building was constructed in 1881 to a design by Hartwell and Richardson.

The church building is roughly L-shaped, with its front facing north toward the square.

The long main section of the building houses the sanctuary, and the rear section, extending a short way to the west, houses a parish hall, offices and other facilities of the church.

[4] The church is a tall single-story brick structure, with sandstone trim and decorative detailing in terra cotta, and has Gothic Revival styling.

Clock face sections with gabled tops interrupt the steeple, which is eight-sided, finished in slate.