Built between 1806 and 1931, they reflect the varied academic history of the campus, and were listed on the National Register of Historic Places in 1978.

It closed in 1877 due to an increase in the number of public high schools.

In 1878 the state opened a normal school on the former academy campus, which has, through a variety of name changes, become the University of Southern Maine.

Near its southern end at College Avenue stands the Art Gallery, an 1822 building that was originally a non-denominational church, and also served for a time as Gorham's town hall.

To their northeast, oriented facing toward School Street (Maine State Route 114) is the original Federal style wood frame Academy Building.