Shivleni Caves are situated hardly half a kilometer to the north-west of Yogeshvari Temple, along the banks of the Jayvanti river.

The inside of the cave is impressive; one hall is supported by thirty-two pillars and adorned with sculptures of Shiva and Ganesha.

[3] An inscription found here dated Saka 1066 records the grant for the maintenance of these caves by the king Udayaditya who is referenced as "Mahamandaleshvar".

As a lasting tribute to that momentous battle, intricate carvings of elephants adorn the surroundings of Shiva, adding a rich and symbolic touch to the spiritual ambience of the area.

[5] A local story claims that the monument is the wedding court of the jogaidevi (Yogeshwari, form of Amba), whose temple is situated nearby.