[1] Except for a short period when it was confiscated by King John (1199–1216), the castle remained in the de Braose family, until the male line died out in 1326, and it passed to the Mowbrays.

Bramber was one of the poorest parts of Sussex, and while it remained a centre of administration, the Mowbrays did not live there; by the 1550s, it was recorded as 'the late castle', used for grazing.

[6] The most prominent remaining feature is the gatehouse tower, which still stands to almost its full height; a window, and floor joist holes are clearly visible.

[7] The original gatehouse appears to have converted into a single tower at some point in the 12th century; another 3 metres were added to its height, while the entrances were blocked up.

[8] The dressed pillars of an entrance can be identified, but the bulk of the remaining walls now consist of only the basic rough stone infill.