In 1590, Toyotomi Hideyoshi dispatched his senior retainer Ishida Mitsunari with an army of 23,000 troops to seize the castle.
Afterwards, the area came under the control of Tokugawa Ieyasu, who assigned his 4th son, Matsudaira Tadayoshi to a 100,000 koku domain.
Abe Tadaaki was a close confidant of shōgun Tokugawa Iemitsu and served as wakadoshiyori and rōjū.
His on Masayoshi served as Osaka-jō dai and Kyoto Shoshidai, as did many of the succeeding generations at Oshi Domain.
Following the Meiji Restoration, the final daimyō of Oshi Domain, Matsudaira Tadanori, married a daughter of Prince Fushimi Kuniie and was ennobled with the title of viscount (shishaku) in the kazoku peerage.