The house served as a hospital during the First World War and later became the most expensive property ever sold in London upon its 1997 sale to the publisher and philanthropist Sigrid Rausing.

[3] John Rocque's map of London indicates that the wings were added to the house between 1745 and 1754, with the north front appearing to date from the same period.

[3] Lady Mary made alterations to the interior, with commissions believed to have been undertaken by the carpenter John Phillips and the architect James Wyatt.

[4] "Those monthly [other sources say fortnightly] parties during the London season were unique and very enjoyable, for Mentia and her husband … were admirably free of class prejudice in persons and opinions, so that all kinds of literary people—refugees from several countries—artists and humble lovers of social enjoyment, mingled with supporters of 'causes' of all kinds" In 1863 Clementia was credited with starting the Ladies' London Emancipation Society at Aubrey House after she was refused entry to the existing organisation because she was a woman.

[5] The Taylors were closely involved in the movement for Italian unification and Giuseppe Mazzini was a frequent visitor to Aubrey House.

During his stay at Aubrey House he was visited by Mazzini, along with noted radical figures such as feminist Emilie Ashurst Venturi, Aurelio Saffi, Karl Blind, Ferdinand Freiligrath, Alexandre Auguste Ledru-Rollin, and Louis Blanc.

[6] In Moncure D. Conway's autobiography, he describes the Taylor's salon at Aubrey House and Clementia's "Pen and Pencil Club" at which the work of young writers and artists was read and exhibited.

[7] Clementia Taylor was on the organizing committee of the 1866 petition in favour of women's suffrage that John Stuart Mill presented to the British parliament; the 1499 signatures were collated in Aubrey House.

[4] The house was bought from the Taylors by City Financier William Cleverley Alexander, an art collector and patron of painter James Abbott McNeill Whistler for c.£15,000.

[8] William Cleverly Alexander had died after a fall down the basement stairs of his country residence, Heathfield Park in East Sussex.

[13] A London County Council blue plaque was unveiled in 1960 to commemorate the notable residents of Aubrey House.

Sir Edward Lloyd, Lady Mary Coke, Peter and Clementia Taylor and William Cleverly Alexander are listed on the plaque.