After his mother's death in 1855 at the age of twenty-six, his father remarried to Lady Susan Catherine Mary Murray (eldest daughter of the 6th Earl of Dunmore) in 1860.
[5] In 1905,[6] he succeeded his father as the 10th Earl of Southesk who had restored the family titles, with the original precedence, by reversal of the 1715 Act of Attainder in 1855.
In 1921, Kinnaird Castle, which was situated in one of the grandest Scottish glens and was the seat of the Earls of Southesk for more than 600 years, burnt to the ground.
A considerable part of the library was saved, but many books impossible to replace, as well as Raeburn's portrait of Lady Carnegie, valued at £10,000, were lost.
[1] Through his eldest son, he was a grandfather of James George Alexander Bannerman Carnegie, who succeeded his maternal aunt, Princess Arthur of Connaught, suo jure Duchess of Fife, as the 3rd Duke of Fife in the Peerage of the United Kingdom in 1959 because her only child, Alastair, 2nd Duke of Connaught and Strathearn, had predeceased her.