Shima was an autonomous district of Ise Province, noted as a prosperous fishing region, and during the Nara period governors of the district were responsible for providing annual gifts of fish and abalone to the Emperor.
Ohama Kagetaka was also a pirate operating in the Ise Bay area of Shima Province during the 16th century.
With the establishment of the Tokugawa shogunate, Kuki Moritaka was confirmed as daimyō of Toba, initially with revenues of 35,000 koku, growing to 55,000 koku under his son Kuki Hisataka, who was transferred to Sanda Domain in Settsu Province.
The domain then reverted to tenryō status under the direct control of the Shogunate for one year.
During the Boshin War, Inagaki Nagayuki remained loyal to the Shogunate, and as a result was fined heavily by the Meiji government and forced into retirement.