The ownership of Rye House was very stable over four centuries; but the fabric gradually ran down, and the buildings diminished.

Andres Pedersen, a Danish soldier who took part in the Hundred Years' War, was denizenised in England in 1433, becoming Sir Andrew Ogard.

In 1683, when the putative plot was actively being discussed, it was occupied by Richard Rumbold, one of the conspirators.

Subsequently (William) Henry Teale developed it into a tourist attraction,[13] buying the House and 50 acres in 1864.

[14] An affray there in 1885 between Catholic excursionists and Orangemen led to a question in the House of Commons.