He was married on 1 April 1747 to Lady Mary Campbell (6 February 1727 – 30 September 1811), the fifth and youngest daughter of the soldier and politician John Campbell, 2nd Duke of Argyll (1680–1743), and his second wife, Jane (c.1683–1767), a maid of honour to Queen Anne and Caroline, Princess of Wales.

Their courtship had been strained, and in retaliation Edward left her alone on their wedding night and from then on virtually imprisoned her.

Their families went to litigation, and eventually produced a settlement in 1750 whereby Lady Mary could live with her mother at Sudbrook but had to remain married to Edward until his death.

His father's estate, including Holkham Hall, went instead to Edward's cousin.

This article about a Member of the Parliament of Great Britain (1707–1800) representing an English constituency is a stub.