Simon never married, instead electing to father children with his slaves, and Free Jamaicans of color; on his death the property would pass to his nephew, Sir Simon Richard Brissett Taylor, the son of his brother Sir John.

Following abolition George Watson-Taylor's finances collapsed, with the property reverting to his wife, on his death, in Edinburgh, in June 1841.

In 1928 the property was acquired by the British government and was the official residence of the colonial secretary until independence in 1962.

In 1980, Vale Royal took over from Jamaica House as the official residence of the prime minister.

[4] Latterly the prime minister has returned to Jamaica House and the Vale Royal building has fallen into disrepair.