St. Gabriel's was founded in 1720 as a Swedish Lutheran church.

The oldest structure is known as Saint Gabriel's 1801 Chapel.

It features a herringbone design in the stone construction.

In 2005, the existing 1959 portion of the building was remodeled and expanded to include more classrooms and a large parish hall.

The Parish was cut off from the Church of England so there were no stated public ministrations.)