The main school building nicknamed "The Castle on the Hill" was built in 1905 and the current addition was added in 1996.

[3] The Fairhaven Academy is a former private secondary school (built 1798) located on the northwest corner of the site.

[4] The school building was donated in 1906 by Henry Huttleston Rogers, who was one of the key men in John D. Rockefeller's Standard Oil Trust.

The original octagonal gymnasium became home to the first indoor basketball court in an American high school.

The high school campus is located on the north side of Huttleston Avenue (United States Route 6), a short way east of the Acushnet River and New Bedford Harbor.

Designed by architect Charles Brigham, it is reminiscent of Tudor architecture with Gothic influences, with a picturesque roofline studded with gables topped by iron finials, and rich carved stonework including gargoyles, grotesques, and depictions of historic figures.

The football, soccer, and field hockey teams play at Alumni Stadium, which sits adjacent to the east side of the newer addition.

The Blue Devils' biggest in-conference rivals are the Old Rochester Regional Bulldogs and the New Bedford Voc-Tech Bears.

In 2022, Fairhaven High School was recognized by Special Olympics International for "excellence in inclusion, advocacy, and respect.