The church was built on what was believed to be the resting places of many labourers killed in the construction of the Rideau Canal.

In 1828, Lieutenant-Colonel John By granted land (most of today's Sandy Hill) to one of his lieutenants, René Léonard Besserer.

Louis Besserer immediately set to work dividing Sandy Hill into lots, however those lots proved difficult to sell due to the sandy and unproductive land, and the lack of churches, schools and business.

Despite the building of the Église Sacré-Cœur (which is still standing just across Laurier) and the 100 families that left Saint Joseph's, the old church was still too small for the ever-growing congregation, and on 23 April 1890, the Superior General of the Oblates authorised the preparation of plans for a new church.

The church was built in the Roman Renaissance style, and was decorated in a way that was similar to Notre Dame.

In rebuilding the church, the architectural style was changed from Roman Renaissance to Neo-Gothic, and in order to make the building more fire-resistant, Father Finnegan replaced the varnished wooden walls with bare cement brick walls.

Two brass plaques were erected by the St Joseph's Parish in honour of those parishioners who served with the allied forces in World War I, many of whom laid down their lives.

[3] A memorial framed scroll with the names of all members of St. Joseph`s parish who volunteered for active service with Canada`s fighting forces in the Second World War and a Memorial Book with short biographies of those members who gave their lives were erected by the St Joseph`s parish.