The caves are located south west of Vijayawada City It is one of the centrally protected monuments of national importance.

[1] The Undavalli caves are carved in the Gupta style of rock-cut architecture, dated back to the 4th-5th century CE.

Most Gupta emperors were Vaishnavas; Many sculptures of the deity Narasimha, as well as other legends of Vishnu and from the text Ramayana are featured in the caves.

[2] There are several caves and the best known largest one has four stories with a huge recreated statue of Vishnu in a reclining posture, sculpted from a single block of granite inside the second floor.

From the high hill above the cave overlooking the Krishna River many fine specimens of rock-cut architecture can be seen.

It is an Impressive Four storey rock cut temple with East facing facade of 29m long, 16m wide.

The first storey accommodates triple shrine at back, each with the pillared hall in front, originally dedicated to the Trinity (Shiva, Vishnu, and Brahma).