The site of the town was named Qunnnoskwamk'ook, meaning long gravel bar in the Malecite-Passamaquoddy language.

[6] At the eastern end the town is a midden, a pile of shells and other refuse that accumulated over 2,000 years due to year-round activity of the Passamaquoddy.

[9] Also typical of British colonial settlement of the time are the town's defensive sites, public spaces, and delineation.

In the late 1800s and early 1900s, St. Andrews became a seaside resort for people from Montreal and Boston who were seeking to escape the summer heat.

The waterfront faces Saint Andrews Harbour and the Western Channel, which is formed by Navy Island.

The town is directly opposite the community of Robbinston, Maine, two kilometres to the west across the river mouth, and 53 km by road.

A local community channel, CHCO-TV, serves the Saint Andrews and Charlotte County area.