[2] Its dedication is to the 11th-century patron saint of Norway, St Olaf.

At the time that the church was founded, the area around Lower Bridge Street was largely occupied by Scandinavians, and it is thought that this is the reason for the dedication.

[1] Constructed in red sandstone with grey slate roofs, the church has a simple rectangular plan.

On the west front is the entrance door, above which is a three-light window, and a bellcote on the gable.

Ten steps lead up to the west entrance from St Olave's Street to the north of the church.