During the 1960s, there were many municipal mergers across Norway due to the work of the Schei Committee.

The last element is yrja which means "gravel" or "rocks", possibly referring to the waves from the sea hitting against the rocky shores.

It was part of the Ibestad prestegjeld and the Trondenes prosti (deanery) in the Diocese of Nord-Hålogaland.

The highest point in the municipality is the 1,275.9-metre (4,186 ft) tall mountain Langlitinden.

The municipal council (Herredsstyre) of Andørja was made up of 17 representatives that were elected to four year terms.