[4] The original land grant was given to Col. Antipas Gilman and associates on June 26, 1782, and was named "Lutterloh."

The highest point in town is in the northwestern part of the township, which is cut off from the main chain of the Green Mountains by a brook.

Lord's Creek flows north through the eastern part of the township, having several tributaries.

[7] The Black River flows north through Albany Village, crosses under the Water Street Bridge before emptying into Lake Memphremagog near Newport, Vermont, which is part of the St. Lawrence River Basin.

[8] The rocks entering into the geological formation of the town are disposed in parallel ranges extending north and south.

Next is a narrow range of Upper Helderberg limestone, followed by a vein of clay slate, the residue of the territory being calciferous mica schist.

In the central and eastern parts of the town there are several rich beds of muck and shell marl.

The Northeast Kingdom Music Festival held annual performances in Albany in the early 2000s.