It was destroyed during a campaign by the Later Hōjō clan of Odawara to conquer the Kantō region from 1565 to 1574.

After the Hōjō clan was destroyed in the Battle of Odawara, they were supplanted by Tokugawa Ieyasu, the castle was reconstructed by Matsudaira Yasumoto in 1590.

Under the Tokugawa Shogunate, the course of the Tone River was diverted in 1654 to prevent flooding in Edo.

The daimyō of Sekiyado Domain, Itakura Shigetsune, took advantage of this situation to construct a canal joining the Tone River with the Edogawa River at Sekiyado, which greatly shortened the voyage and enhanced the revenues of his domain.

The outer buildings of the castle had already been lost in a fire in 1870, and the remaining structures were abandoned in compliance with this directive in 1872, and pulled down by 1875.