Rikan Castle fell into the hands of Ukita Naoie, a vassal of the Mōri clan.

Ikeda Yoshyuki promptly renovated the castle with stone walls and a large three-story tenshu, all connected by corridors.

He also built a daimyō palace at the base of the hill, a castle town and a tradesman's district along the highway.

When Ikeda Terumasa returned a couple of years later, he was shocked at the magnificence of the castle and immediately ordered the destruction of the tenshu for fear that it would create hostility with the Tokugawa shogunate.

Hirafuku Domain became tenryo territory administered by a hatamoto from the Matsudaira clan, who built a jin'ya in the post town.