The shrine is at the base of Mount Togakushi (1,904 metres (6,247 ft)) in Myōkō-Togakushi Renzan National Park.

In one theory[citation needed], the upper shrine, or Oku-sha, is said to have been first constructed in the 5th year of the Emperor Kogen (210 BC) while Buddhist tradition holds that a monk named Gakumon discovered the Oku-sha area and began the practice of Shugendo there in the 2nd year of the Kasha era (849 AD).

According to the Nihon-Shoki, the Emperor Tenmu had a map of the area made in 684 AD and a temporary building built the following year.

Two major esoteric Buddhist sects, Shingon and Tendai fought for the hegemony of Togakushi Temple.

Beyond the cedar-lined path, you will be able to see the torii gate for Oku-sha at the bottom of the mountain and the shaden main building of the shrine as well.