He was one of thirteen children (of whom seven reached adulthood) born to Eva (Van Cortlandt) White (1737–1836) and wealthy New York City merchant Henry White (1732–1786).
The Whites were ardent Loyalists during the American Revolutionary War, and in 1783 the family abandoned their home in New York and moved to London.
Among his extended family was uncle Augustus Van Cortlandt.
[4] He was later promoted to Major-General of the Grenadier Guards,[1] before becoming General.
[5] White was twice married, first to Sophia Heaton Coore of Hendon, Middlesex in 1802.