[1][2] The palace was built during the reign of Khengarji III as a summer resort for his son and heir to the kingdom, the Yuvraj Shri Vijayaraji, for whom it was named.

Its distinctive Rajput architecture largely refers to the plan of palaces of Orchha and Datia.

The palace is set in the middle of gardens with water channels and marble fountains.

The jalis, jharokas, chhatris, chhajas, murals, stone carvings, and colored glass work on windows and door panels were created by architects and craftsmen from Jaipur, Rajasthan, Bengal, and Saurashtra, as well as the local Kutchi artisan community, the Mistri and Suthars.

The windows ensure the feeling of being in the open space, with sea winds passing through.