[1] Among his siblings were Lady Cecilia Underwood (the second wife of Prince Augustus Frederick, Duke of Sussex, the sixth son of King George III).

[2] From his father's first marriage to Catherine Annesley (the only daughter of the 1st Viscount Glerawly), his half-siblings included Arthur Gore, 3rd Earl of Arran, Lady Anne Jane Gore (the third wife of John Hamilton, 1st Marquess of Abercorn), and Lady Catherine Charlotte Gore (wife of John Evans-Freke, 6th Baron Carbery).

[2] Gore was married to Sarah Rachel Fraser (1803–1880) of Halifax, Nova Scotia.

[5] Together, they were the parents of five children, including: Sir Charles died on 4 September 1869 in Chelsea, London.

He is buried in Brompton Cemetery in London near the north end of the central colonnades.