It was organized as a province under the Ritsuryō reforms in the later half of the seventh century, and the name "Oki-no-kuni" appears on wooden markers found in the imperial capital of Nara.
During the late Heian period, due to its remoteness, Oki Province came to known as a place for political exile.
After the Amago fell and the Tokugawa shogunate was established, Oki Province was declared a tenryō dominion under the direct control of the shōgun.
The exact location of the capital of the province is not known, but is believed to have been somewhere within Suki District on Dōgojima, within the borders of the modern town of Okinoshima.
The Kokubun-ji still exists as a Shingon sect temple in Okinoshima, and the foundation stones of many of the original buildings can be found within its grounds, although a complete archaeological investigation has yet to be performed.