[1] The site was originally a Norman castle built by Roger Bigod in about 1100 to take advantage of the natural protection provided by a curve in the River Waveney.

[2] Roger's son Hugh was a prominent player in the civil war period known as the Anarchy (1138–1154), and his loyalty was called into question during the early years of the reign of Henry II.

[3] Bigod was on the losing side in the revolt of 1173–1174, and Bungay was besieged, mined and ultimately slighted by royal forces.

Later, in the early 1790s, it was purchased by Daniel Bonhôte, a local solicitor, but was sold back to the Dukes of Norfolk in about 1800.

Restoration work under the supervision of Hugh Braun began in 1934, following excavations by the amateur archaeologist Leonard Cane.