However, as the Crusaders marched towards Jerusalem, they did not leave enough protection and the castle was recaptured by Banu Ammar.

It was Raymond IV, Count of Toulouse, who reconquered the city and the castle in February 1102 after a two-week siege.

[2] The fortress was part of the County of Tripoli, and was besieged several times including one in June 1180 by sea, but without effect due to resistance.

From 3 to 11 July 1188, Saladin also besieged the castle and devastated the lower town, which had previously been emptied of all its inhabitants, but could not gain access to the keep, defended by several brother-knights and the Master of the Order himself.

It had a postern which went out directly on the sea which allowed boats to be able to supply food and weapons during a siege.