[3] The name Kalayat appears to be derived from "Kapilayatana", which translates to the "home of sage Kapila".

According to local legends, in ancient times, five brick temples were located beside the holy tank.

The bricks in the sikhara are joined to form beehive patterns similar to the facade of the rock-cut chaitya hall of Ajanta or Ellora.

[3] There are stairs at the back leading to the Kapil Muni Tirtha comples, where pilgrims take a bath before worship,[5] The pond is named Chyavan Giri Kund after another Vedic sage Chyavana who regained health and youth by consuming Chyawanprash (made by RajVaidhya twin Ashwini Kumar brothers) at his Ashram on Dhosi Hill near Nuh in Mewat district.

There is also a temple of Katyayini devi who was the daughter of Sanskrit grammarian, mathematician and Vedic Sage Kātyāyana.