Established in 1854, Grace has the largest membership of any parish in the Episcopal Diocese of Newark, with traditional "high church" Christian worship and a strong choral music program.

These included the Furman and Sylvester families, Margaret Quanto, who was on the parish charter, and the Sunday School –organized by 6 African American girls who had been asked by the Rev.

Grace was unusually diverse in race, status and character its early days, a leading sign that the parish's growth was a result more of the mixed community's genuine worship and spiritual interest in the music rather than pre-existing social groups (as was often the case with the other denominations).

Grace Church was also backed by the wealthiest Madison citizens including the Treadwells, Goulds, and the prominent slave-owning Gibbons family of Georgia.

Grace grew so quickly in its foundational years in a town with long-established Presbyterians, Catholics, and Methodists, partly because of the hymns and chants offered in the Episcopal services.

A professional soprano soloist, Thomas also founded the Grace Church Sunday School and later became the full music director of the parish in 1969.

[4] Ever since the choirs were organized in the early 20th century, Grace has had a flourishing choral program that involves children and families in the local school districts.

Grace's current music director since 1991, Dr. Anne Matlack, a graduate of Yale, also directs the Harmonium Choral Society of Northern New Jersey.

Its worship incorporates people of all ages into the traditional Eucharistic liturgy, offering a lively, modern community into the timelessness of Trinitarian life.