The parish church is located on Hope Street, having been in continuous service since its initial building in 1905.

St. Joseph's Parish then included the towns of Mountain View, Los Altos, Sunnyvale, and Mayfield (south of Palo Alto), ranging from San Francisco Bay to Skyline Ridge in the Santa Cruz Mountains at that time.

The population growth — spurred by the railroad — put great pressure on the parish and its church within a few years after its completion.

Starting in 1948, under the direction of Father James Doyle, the church acquired 15 acres (6.1 ha) off Miramonte Avenue near El Camino Real and established St. Joseph's Elementary School and Holy Cross High School for girls.

As such, the main floor of the church contains the narthex, nave, transept, sanctuary, and sacristy.

The altar rails have since been removed, allowing easier access to the laity who now participate in the celebration of the Mass.

The oils are then received at the Holy Thursday Mass of the Lord's Supper, in accordance with local ritual.

[5] The main floor of the church is decorated with several stained glass windows, reflecting the Roman arched architecture.

There is an additional stained glass window at the rear of the church, not easily seen above the choir loft and organ pipes.

[18] Although it is a Catholic School, a non-discriminatory policy is in effect, whereby students of any race, color, religion, national or ethnic origin may be admitted.

Students who are not Roman Catholic are exempted from parts of the curriculum which are specific to religious education or ministration of sacraments.