[1] He was the son of Elizabeth Newton and Dr. Nathaniel Ogle of Kirkley Hall, Northumberland, who served as Physician of the Forces, under the 1st Duke of Marlborough.

[11] Through his daughter Barbarina, he was a grandfather of author Arabella (née Wilmot) Sullivan (1796–1839), who married Rev.

[12] Through his son Charles, he was a grandfather of Captain Sir Chaloner Ogle, 3rd Baronet (1803–1859),[13] who married Eliza Sophia Frances Roe, parents of Sir Chaloner Roe Majendie Ogle, 4th Baronet (1843–1861),[14] who died unmarried at age 18 and was succeeded in the baronetcy by his younger half-brother Sir William Ogle, 5th Baronet (1823–1885), who "had been an invalid from his cradle".

[17] Confusion has arisen over another portrait, held at the National Maritime Museum at Greenwich, but this is now known to be a flag officer, previously thought to be Sir Chaloner Ogle.

[18] Another portrait of Sir Chaloner Ogle of Worthy by a follower of Joshua Reynolds was sold at Christie's auction house in 2009, which bears the same likeness to the painting in the National Maritime Museum.