Founded in 1874, the building it occupied in Baltimore from 1879 to 1961 is listed on the National Register of Historic Places under the name Cummins Memorial Church.

Cummins toured the northeast, establishing churches in New York, Montreal, Chicago, Philadelphia and Ottawa before returning to Baltimore.

[4] Other notable parishioners in the mid-20th century included disability advocate Joni Eareckson, who was confirmed at Bishop Cummins prior to the diving accident that left her paralyzed,[5] and Edward and Joyce Brumbaugh, whose daughter Gayle married Michael Ford, son of then-Vice President Gerald Ford, in 1973.

Cox officiated the ceremony at a different Catonsville church due to construction at Bishop Cummins.

[8] The historic building is located at 1210 West Lanvale Street in Baltimore at the corner of Carrollton Avenue.