Byfleet Manor's precursor was a royal hunting lodge given by Edward II to Piers Gaveston, his reputed lover.

In 1672 the lands were granted to Lord Holles and others to hold in trust for Queen Catherine of Braganza for her life, and afterwards for Charles II of England and his heirs.

In 1694 Sir John Buckworth, lord of the manor of Byfleet, was accused of neglect in repairing a bridge over the Wey.

It was found, however, that he was not responsible for such repair, as he was only a "termer for years" in the manor under a "lease made by the late queen mother's trustees."

[8] Byfleet has been used as a filming location including; Downton Abbey, Agatha Christie's Poirot: After the Funeral, Cranford and Into the Woods.