Around the mid-13th century the family had managed to acquire, through marriage and carefully using the rivalry between the bishop and local nobles, titles to Jenins, Maienfeld and Prättigau.

[1] By 1275 the castle was owned by the bishop and had been granted as a fief to Walter IV von Vaz.

Around 1288 the Abbot of St. Gall, Wilhelm of Montfort, fled the anti-abbot, supported by Rudolf I of Germany, to Alt-Aspermont.

The last bishop's bailiff was Jorg Rink von Baldenstein, who ruled over Trimmis and Zizers until the Ilanz Articles were accepted in 1526.

During the Bündner Wirren in the early 17th century, the castle was occupied by Austrian forces in 1622, but again abandoned shortly thereafter.