In 1932, Astor was appointed secretary to Victor Bulwer-Lytton, 2nd Earl of Lytton, at a League of Nations Committee of Enquiry in what was then known as Manchuria.

In World War II, he served as a naval intelligence officer, acquiring no distinction, but gaining many influential contacts.

In response to being told during one of the trials arising out of the scandal that Astor had denied having an affair with her, Rice-Davies famously replied, "Well he would, wouldn't he?"

They had one son together: William married Phillipa Victoria Hunloke (10 December 1930 – 20 July 2005, whose maternal grandfather was Victor Cavendish, 9th Duke of Devonshire) on 26 April 1955 and they were divorced on 3 June 1960.

They had two daughters: Astor died in Nassau, Bahamas, aged 58 from a heart attack[3] and was buried in the Octagon Temple at Cliveden.