Born in London in 1826, he was the second (but eldest surviving) son of David Ogilvy, 9th Earl of Airlie, and his first wife, Clementine, daughter of Gavin Drummond.

[2] Ogilvy was educated at Christ Church, Oxford, where he graduated with a BA in 1847.

[5] In 1872, he was appointed Lord High Commissioner to the General Assembly of the Church of Scotland, an office he held until the following year.

[6] He was a founder and served as first President of the Girls' Public Day School Company.

[6][7] Ogilvy died in Denver, Colorado, in 1881 and was succeeded in his titles by his older son, David.