The construction of the fort dates back to the 12th century when the city of Kurnool was used as a base on Tungabhadra river crossing.

Kurnool was reigned by Vijayanagara Emperors Devaraya II and Achyutaraya who succeeded Krishnadevaraya built the initial fort between 1530 and 1542.

The gateways of the fort were constructed by Gopala Raja, the grandson of Rama Raya in the 17th century.

Locals and legend state that Konda Reddy was under attack, and used the tunnels that the fort housed to escape.

Konda Reddy eventually escaped from the fort, but had to lose his territory to Golconda Nawabs.