These caves located at Uperkot beyond the 300 ft deep moat, close to Adi Kadi Vav, were carved in 2nd–3rd century A.D.

According to ASI "The cave group is in three tiers, with all members of each galleries shown in semi-relief, but only two storeys having regular floors.

Under the corridor, in the rest of the area, in the walls on the north-east and west sides are stone bench-recesses, divided into long compartments with a base moulded in architectural courses below, and a frieze above, ornamented with horseshoe shaped chaitya windows and checker carvings.

[1][2][3] The lower floor has exquisitely carved pillars whose base, shaft and capital carry unique decorative design.

These caves are gilded with beautiful pillars and entrances, water cisterns, horseshoe shaped chaitya windows, an assembly hall and cell for meditation.