[1] His paternal grandparents were Daniel Leroy and Ingenatia (née van den Bergh) Le Roy.

The firm was one the largest commercial house in New York City, shipping goods and trading product throughout the world.

[9] Hannah's father died in 1781 in British-controlled New York, having moved there from North Carolina after 1777 after refusing to take the Oath of Allegiance to the new United States.

He also owned a country home in Pelham, New York, where his daughter, Caroline, married Daniel Webster.

Together, they were the parents of had ten children who survived to adulthood, including:[9] LeRoy died on March 31, 1841, in New York City.