Centered around the Federal Hill Green, it developed as a fashionable residential area, and features a large number of fine Italianate and Victorian houses.

A separate parish had been established in 1744 at the top of Federal Hill, a prominent rise northeast of the present downtown.

Changes in transportation routes in the 19th century reduced this center's economic importance, and most civic functions were eventually established elsewhere.

It remained a focus of religious activities (there are four churches in the district), and became a fashionable location for wealthy businesspeople to build homes.

[2] The historic district is roughly bounded on the west by a railroad right-of-way which skirts around the base of the hill, and on the south by High Street.