Neville was the grandson of the famous novelists Edward Bulwer-Lytton and Rosina Doyle Wheeler.

During World War I, Neville Lytton served as an officer on the Western Front and saw active duty at both the Somme and Amiens.

[citation needed] It is possible to see Lytton's frescos reflecting his experiences in the war on display in Balcombe village's Victory Hall.

Before their divorce in 1923, they were the parents of three children:[7] On 1 May 1924, the Earl remarried to Rosa Alexandra Fortel of St Rambert-en-Burgey in Ain.

The family resided in France and with his second wife he was the father to a fourth child:[7] Lord Lytton died in Paris on 9 February 1951.