It was a fiercely fought over fortress between Bavaria and the Tyrol and had a pivotal role in an armed conflict in 1336, when Margrave Charles of Moravia had to abandon his pursuit of the Bavarians when the fortress blocked his route.
In 1342, Margarete "Maultasch", Duchess of the Tyrol, received Kufstein as a wedding present from her husband Louis of Brandenburg, son of Emperor Ludwig of Bavaria.
When Margarete handed all of the Tyrol to the Habsburg Duke Rudolph IV in 1363, the Bavarians demanded that she return her original wedding gift and successfully invaded Kufstein.
The list of prominent Hungarians imprisoned in the fortress includes: It was also where some 100 of the Poles arrested after the 1846 Kraków Uprising were held.
The fortress has an unusual war memorial, the Heroes' Organ [de] (Heldenorgel).