[2][3] His son, Sir John Williams, 2nd Baronet was High Sheriff of Kent and represented Herefordshire in Parliament.
[4] As Sir John had no sons, his nephew, Edward's grandfather, inherited the baronetcy but the Elham estate passed to the 2nd Baronet's daughter and her husband, Thomas Symonds.
[6] Williams married Mary Ellis le Heup (1728–1768), a daughter of and Elizabeth (née Lombard) le Heup (daughter of Peter Lombard of Burnham Thorpe) and Isaac le Heup, MP who was a brother-in-law of Horatio Walpole, 1st Baron Walpole.
Mary's sister, Elizabeth le Heup married John Lloyd.
Together, they had one son who predeceased him and a daughter:[5] After his first wife's death in 1768, he married Mary Riley.