The castle was ceded to make a hermitage for Basilian monks.
For a time, it was occupied by Muslim forces from Africa.
By the middle of the 13th century, the castle was occupied by the Swabian rulers, then the Angevins, then Aragonese.
In 1483, the owner, Raimondo Orsini Del Balzo, began converting it into a residence.
Such work continued in 1606 under Gaetani D'Aragona It then passed to the families of the Dukes of Belgioioso, who owned it till the early 1800s.