In 1909, the school moved to new premises in Dover, and the Asylum building was taken over by the Territorial Army and renamed the Duke of York's Barracks in 1911.

[5] During the Second World War, the courts martial of German spies, Josef Jakobs and Theodore Schurch, (both tried under the Treachery Act 1940) were both conducted in the building.

[3] On 20 September 1973 a Provisional IRA bomb exploded at the barracks injuring five people, three civilians and two soldiers, at which time it was the headquarters of the 14th Parachute Brigade (TA).

At that time the building served as the Headquarters for the Territorial Army in Greater London, and as the home of Territorial units 144 Parachute Field Ambulance RAMC(V), 257 (Southern) General Hospital RAMC, 21 Special Air Service Regiment (Artists), and companies of 10th Battalion, Parachute Regiment and the London Irish Rifles.

[10] The development includes a public square, upmarket housing and retail outlets, and part of it has been let as new premises for the Saatchi Gallery, which relocated there in 2008.