[5] In the early 19th century, the manor of Walton in Gordano, including Walton Castle was bought by Philip John Miles[6] who also held properties and extensive estates elsewhere including Kings Weston House, Leigh Court, Cardigan Priory and Underdown in Ledbury, Herefordshire, whence his family had originally come.

In 1979, Sir William Miles's daughter and his son-in-law, Martin Sessions-Hodge, spent £100,000 and over a year restoring the ruin into a five-bedroom, three-bathroom house.

The couple made further alterations to the castle, though some of these had to be reinstated due to problems with unauthorised removal of crenellations on a listed building.

After the council formally warned Margarita over the number of noise abatement complaints, in 2013 she sold her share of the castle for £1.5M to Walton Properties Ltd., a Guernsey company in which her estranged husband has a minority interest.

In 2009 comedian Bill Bailey was guest of honour at an event designed to raise funds for the Teenage Cancer Trust.