[2] It was in the possession of Thomas of Woodstock, a son of King Edward III of England, until his death in 1391, when it reverted to the Crown.

Caldicot is mentioned in the Domesday Book of 1086, not for its castle, but as an agricultural holding of Durand of Gloucester, Sheriff of Gloucestershire.

Walter FitzRoger, Durand's nephew, inherited his lands as well as his father's office of Constable of England which remained with the lords of Caldicot.

[4] Milo's five sons died childless so his eldest daughter, Margaret, took to her marriage with Humphrey II de Bohun the Earldom of Hereford, the Constableship of England, and Caldicot.

Their son Humphrey III de Bohun was the probable builder, in about 1170, of the stone keep and curtain walls of the present-day castle.

[1] In 1376 the manor, along with 70 others, passed to Thomas of Woodstock, the fifth son of King Edward III of England, when he married Alianore de Bohun.

In the early twentieth century, many rooms were decorated with memorabilia from Nelson's first flagship, HMS Foudroyant which was owned by G. Wheatly Cobb at the end of its life.