[1] The first church building, designed by Philadelphia architect R.A. Gilpin, was erected at Ninth and Chicago streets in Manitowoc.

[1] The church also provided Episcopal missions in Branch, Manitowoc Rapids, and Two Rivers through the remainder of the 1800s.

Construction on a new building commenced in 1901, using plans Gray had brought that were based on an Anglican church near Oxford, England.

The reredos and tabernacle behind the altar are of carved Flemish oak, matching the surrounding walls, and rise into a set of panels containing wood burnings.

A plaque designates the area in memory of first rector Gustaf Unonius, who died the same year the church was completed.

[4] St. James' is located on Eighth and State streets in the heart of the neighborhood locally referred to as Holy Hill (not related to Holy Hill National Shrine), immediately north of the National Register of Historic Places Eighth Street Historic District.

The close proximity of historic ELCA Lutheran, Episcopal, Presbyterian, and Roman Catholic churches and the Jewish synagogue in this neighborhood has facilitated ecumenical partnership and collaboration among those congregations.

A variety of community forums, joint educational opportunities, and ecumenical worship are offered by these congregations.

Engel (rector from 1860–1864) gave up his pastoral duties for a time to serve as a military chaplain for the 14th Wisconsin Volunteer Infantry Regiment during the American Civil War.

Worship is from the 1979 Book of Common Prayer, primarily using Rite II, written in modern language.