In 1522, Spain lost the peñón to a Moroccan Berber attack that resulted in the deaths of the entire Spanish garrison.

Ali Abu Hassun, the new Wattasid ruler of Morocco in 1554, then gave the peñón to the Ottoman troops who had assisted him in gaining the throne.

At Peñón, Sancho unveiled the plan made by Venegas, scaling the walls at night, which the counsel unanimously deemed impossible, yet they decided to carry on anyway.

He carried with him a large retinue of servants with luxury food whom, alarmed by the first contacts, fled to the coast, where local Berber bandits stole their goods.

The Spanish fleet attempted to cover their retreat with cannonfire, but Bazán called to stop upon realizing their bad position would make them hit their own troops.

He noted the enemy garrison was undersupplied and would be easy to submit, yet if the Spanish retreated, this would only give the locals the chance to resist better a future attempt.