Until its west wing soon became Grove House it was set apart from the east end of a row of 18th-century houses running from Palace Gate (near Kensington Palace) to the east, and was part of a phase of such houses facing Kensington Gardens as far as Knightsbridge, a broad bridge across the West Bourne.
Its interiors were planned and supervised by leading architect Robert Adam.
Between 1808 and 1821 William Wilberforce lived in it; he co-led the abolition of the slave trade and then slavery in the British Empire.
In May 1851, certain floors were converted to restaurant by the chef Alexis Soyer, with the aim of competing with and catering for the Great Exhibition in Hyde Park to the north.
Today the Royal Albert Hall takes up its site.