[6][7] Nasir Khan's descendant Sultan Bahadur Shah (1596–1600) declared his independence and refused to pay homage to the Mughal emperor Akbar and his son Daniyal.

[8] During the Second Anglo-Maratha War, on 18 October 1803, Company forces took the pettah of Asigarh with a loss of two killed and five wounded.

In March of that year, a massive British contingent laid siege to Asirgarh, capturing and occupying the town next to the fort to serve as a temporary base of operations.

The 1,200-strong garrison was subject to constant artillery bombardments before the British launched an assault, which led to the fort's capture on 9 April.

There is a local legend that Ashwatthama, a character in the Indian epic Mahābhārata, used to come to this temple to worship and offer flowers each morning to Lord Shiva.