[1] Among his siblings was younger brother, John Toler, 1st Earl of Norbury, the Chief Justice of the Irish Common Pleas who was considered to be one of the most corrupt legal figures in Irish history.
[3] The Toler family was originally from Norfolk, but settled in Ireland in the 17th century during the reign of Charles I, when an ancestor who was a successful soldier in Cronwell's army obtained a grant of lands in County Tipperary and settled at Beechwood.
[5] He represented County Tipperary from 1776 to 1790, alongside Henry Prittie (later 1st Baron Dunalley), Hon.
[7] Together, they were the parents of:[8] Toler died on 27 June 1796 at Beechwood, Nenagh, County Tipperary, Ireland.
[10] Through his daughter Harriet, he was a grandfather of Eliza Osborne (d. 1853), who married Thomas Gibbon Fitzgibbon; Harriet Osborne (d. 1865), who married Dr. Jean Costy of Luc-sur-Mer, Normandy; and Sir Daniel Toler Osborne, 12th Baronet (1783–1853), who married Lady Harriet Le Poer Trench, daughter of William Trench, 1st Earl of Clancarty.