Captain Masham Elwin was put on trial for criminal conversation with Brograve's wife, before the Right Hon.
Brograve had canceled his will immediately on discovering his wife's infidelity, and like his father before him, died intestate, the last in the direct male line of this ancient family.
His heir at law was a distant relative, Henry John Conyers of Copped Hall, Essex.
Worstead House and most of the other estates were put up for sale shortly after Brograve's death in 1828, although Conyers appears to have kept Waxham Hall for a time.
[clarification needed] He then "found himself unable to answer his engagements" and shot himself two days later with a duelling pistol inserted in his mouth while sitting up in bed.