This dates back to the Middle Ages, when a manor was enlarged by the building of smaller houses around it in a ‘court’.

The castle construction was carried out by the lords of the Ferté in response to the wishes of King Philippe II (Augustus) (1165–1223) to fortify towns in order to defend the newly conquered territory.

Around 1358, during the imprisonment of King John the Good of France, municipal troops of Abbeville demolished the castle to prevent the English any means to establish themselves in the region.

Rebuilt soon after, in 1420, by Simon of Boulainvilliers, it was subsequently fought over by the kings of France and England (and the Burgundians) and left in ruins.

In 1589, during the French Wars of Religion, the leaguers of Abbeville attacked the troops of King Henry IV of France and took possession of the castle.