[2] Bergavenny married Elizabeth Thornicroft (d. 1778) on 21 February 1722/3 at St Mary Magdalen Old Fish Street.
He died of smallpox on 15 November 1723 in Soho Square, and was buried at Sheffield, Sussex.
He had posthumous children by Elizabeth, twin girls born on 20 November 1723, both of whom died on 1 December 1723.
As he died without male issue, the Barony passed to his younger brother, Edward Nevill, 15th Baron Bergavenny.
Thomas Hearne described Bergavenny as "a most ingenious sensible young gentleman, but very much deformed".