Thomas Bacon, former rector of St. Peter's Church in Talbot County, was appointed third "reader" of the parish, which by then was the colony's richest with an income of £400 sterling, but he was expected to first compile the laws of Maryland in Annapolis.

[5] Bacon's successor, Bennet Allen, the black sheep of a noted clerical family in England, technically served for seven years, but caused a scandal for his lack of learning as well as insistence upon holding another living (St. James Herring Bay) at the same time, contrary to colonial legislation but supposedly authorized by the Lord Proprietor.

George Bower on March 24, 1793, Bishop Thomas John Claggett administered his first confirmation on ten members of All Saints Church.

[7] As the population of Frederick grew in the late-18th and early-19th centuries, the need for a larger, more accessible church led the vestry of All Saints Parish to call for the construction of a new building on a lot purchased from Dr. Philip Thomas and Richard Potts on Court Street.

The 1830s, 40s, and 50s were a tumultuous period for the parish, reflecting the social and political tensions which impacted the United States in this era.

On a more secular note, rectors of the parish in this period also held political views in favor of and against the institution of slavery, causing occasional controversy in the church.

After corresponding with the firm of Richard Upjohn and Company of New York, plans for the new Gothic Revival-styled church were procured and the cornerstone was laid in 1855.

In the fall and winter of 1862-1863, the church was used as a field hospital during the Maryland Campaign, housing wounded soldiers from the Battles of South Mountain and Antietam.

The brickwork of the current seven-bay by three bay, two storey church is common bond, with brownstone trim and a high exposed fieldstone foundation.