This construction is known to us by a charter of 1030 and documents concerning the church of Saint Léger and the convent buildings which are adjacent to it, built from 1031 by the Benedictines.

Around 1200, the castle was rebuilt in stone, on the Charente river bank facing the docks and walls built to circle the town.

[1] After the death of King John in October 1216, Hubert de Burgh, seneschal of Poitou, had Cognac seized, sparking a war with Renaud II.

King John's widow, Isabella, heiress of Anoulême, reasserted her rights over Cognac and enfeoffed her new husband, Hugh X of Lusignan.

The castle was sold as national property for demolition, but in 1795 was purchased by traders Messrs Otard and Dupuy, to install cellars.