[5][6] Fishbourne is listed the Domesday Book of 1086 in the Hundred of Stockbridge[7] as having 18 households, two mills, meadows and plough lands, with an annual value of 7 pounds.

On the site have been found remains dating to around the time of the Roman conquest of Britain in AD 43.

It is said to have been held of the Crown in chief by 'Sir Thomas White and others' in 1558, but in 1560 the Manor of New Fishbourne was granted to John Fenner, who died on Christmas Day 1566.

During The Restoration, Cawley's estates were forfeited and Fishbourne was among the manors given to James, Duke of York.

The Manor House is dated 1687 on a North wing added to the building by Sir Thomas Miller.