It was first built during the rule of the Armenian Bagratid dynasty and then rebuilt in 1153 by Firuz Akay Commissioned by Sultan Melik Izzeddin Saltuk II.

The castle, which was destroyed by Timur in 1386, was rebuilt again in 1579 by Lala Mustafa Pasha, who came to Kars ordered by the Ottoman Sultan Murat III.

Just inside the main entrance is a shrine containing the tomb of Jelal Baba who died during the Mongolian invasion in 1239.

[1] In 2005, the castle hosted a music concert by Turkish pop singer Sezen Aksu attended by around 25,000 people.

[2] During the Islamic fasting month of Ramadan in 2011, a Mevlevi Sama ceremony was held for the first time at the castle.