Having no dedicated structure, masses were celebrated in the ballroom of the illustrious Hotel Gramatan by Immaculate Conception pastor John McCormack who traveled by horse each Sunday.

In 1906, the mission purchased a former Bronxville schoolhouse on the corner of Park Place and Kraft Avenue, converting it into St. Joseph's Chapel.

The new building was designed by Yonkers architect William H. Jones in the English Gothic Revival style, constructed from stones quarried locally in Westchester.

The young Ted Kennedy was an altar boy at St. Joseph's Church and in 1957 was married there to his first wife Joan by Cardinal Francis Spellman.

[4] St. Joseph School opened on September 10, 1951, adjacent to the church at 30 Meadow Avenue and was staffed by the Adrian Dominican Sisters, while operated by the parish.

Patrick Sheridan (a future bishop) oversaw the start of construction in 1985 of the parish center, which included a gymnasium and additional space for teaching and offices, with the dedication by John Cardinal O'Connor occurring on September 27, 1986.