Born at Belle Isle Castle in County Fermanagh in Ulster, he was the second son of Sir Ralph Gore, 4th Baronet, and his second wife Elizabeth, only daughter of St George Ashe, at that time Church of Ireland Bishop of Clogher.
[5] In the following year, he was made a lieutenant-general[6] and in 1788, during the absence of Sir William Augustus Pitt, was acting Commander-in-Chief, Ireland.
[2] On 23 February 1754, Sir Ralph Gore married, firstly, Katherine, eldest daughter of William Conolly and Lady Anne Wentworth.
[12] Belle Isle (previously known, in Gaelic times, as Ballymacmanus Island or Senadh-Mic-Maghnusa or, simply, Senad[13][14][15]), near Lisbellaw, had been in the Gore family for generations, but it was Lord Ross's father who built the castle.
His son, who was born there, spent many years improving and expanding Belle Isle Castle and creating a magnificent garden.