There are no extant structures left; however, a park was built on the site where the castle once stood, and a stone monument and some explanatory signboards were erected by the city.

[1] In 1465, Toda Munemitsu (c. 1439–1508), a retainer of the Ashikaga shogunate was ordered to advance from Kyoto into Mikawa Province, to hunt down members of the Maruyama and Ōhira families and to subdue the area.

With the Atsumi area subdued, he left Tahara Castle in the care of his eldest son, Norimitsu, and turned his attention to the east.

Defense of Yoshida Castle and the east Mikawa region was commanded by Sakai Tadatsugu, whom Shingen knew to be a formidable tactician.

At Nirengi Castle, Ieyasu personally led his heavily outnumbered rear guard against the Takeda forces in a delaying action.

With reinforcements from the Oda clan, Ieyasu was able to rally his troops, fight off the Takeda, and recover Nirengi and other castles that had fallen to the enemy.

Following the Siege of Odawara (1590), proprietary rights to the area were transferred to Toyotomi Hideyoshi, while Tokugawa Ieyasu and his loyal forces moved east and took possession of the Kantō region.

During the Edo period, lower class and impoverished samurai in the area used the wood of the elm trees around the castle site to craft wooden pestles, a traditional kitchen utensil in Japan.

[10] After the end of World War II, the Ōguchi Family lived for a while on the land, in a small house (6 x 3 tatami mats) called Kazaki-an (風樹庵),[11] which can be translated as "Wind-Among-the-Trees Hermitage".