In 1804 Edward sold the Ewyas Lacy tithes by auction.

[3] He was commissioned as Major-Commandant of the Royal Radnor Light Infantry, a Militia regiment, on 23 June 1819; his eldest son, Edward, Lord Harley, took over command on 1 July 1822.

[4] He and his wife Jane Elizabeth Scott (a notable mistress of Lord Byron) married 3 March 1794 and had eight children, including the following:[5][6] Due to his wife's infidelity, doubts were expressed about the paternity of many of the children, who were unkindly referred to as "the Harleian Miscellany."

The earl died on 28 December 1848 at his seat at Brampton Bryan Hall.

This biography of an earl in the peerage of Great Britain is a stub.