[1] He was the son of John Ward, 1st Viscount Dudley and Ward, and his first wife Anna Maria (née Bourchier) and educated at Oriel College, Oxford.
The latter year he succeeded his father in the viscountcy and entered the House of Lords.
He had a natural daughter Anna Maria Ward (1778–1837), by his Viscountess (when she was still Mrs. Mary Baker, whom he later married on 15 July 1788).
Lord Dudley in his will made an ample provision for the girl and appointed his widow, who died in 1810, and Henry Jerome de Salis as her guardians.
[4] Anna Maria married Sir Horace St Paul, 1st Baronet, MP, on 14 May 1803.