Shortly thereafter, the original Episcopal congregation moved out and sold the building to the new Calvary Baptist Church, which has occupied it ever since.

The church and rectory (now used as an annex) are on, respectively, the north and south sides of St. Paul's Place between State and Spring streets in downtown Ossining.

There is a large building to the east of the church; otherwise, the only immediate neighbors are parking lots as the downtown area gives way to residential neighborhoods in all directions other than north.

On the inside the church has exposed wooden roof trusses, the stained glass windows, and a large pointed chancel arch.

All are double wooden doors in blind pointed arches with decorative woodwork paneled transoms.

The cornice does not continue onto the south facer of the tower; it is replaced by a centrally located shield-shaped stone commemorative plaque reading "St. Paul's Church, A.D. MDCCCXXXV".

Above it is another cornice at the top of the roof, setting off a final stage with a narrow pointed-arch louvered vent in the center of each face.

[4] The rectory across the street is a two-and-a-half-story three-bay brick residence with a one-and-a-half-story wing projecting from the south and a one-story center-gabled porch across the north (front) elevation.

It has Gothic detailing similar to that on the church, in particular two-over-two double-hung sash pointed-arched windows.