In 1780, he married Anne,[4] the only surviving daughter and heiress of Field-marshal Sir George Howard and his wife Lucy Wentworth, daughter of Thomas, Earl of Strafford, and became the father of Major-General Howard Vyse, anthropologist and Egyptologist, and his sister Georgiana Anne Vyse.

He distinguished himself on several occasions, particularly at the Battle of Beaumont on 26 April 1794, where at the head of two brigades of heavy cavalry, he materially contributed to the victory, and at the evacuation of Ostend, which he superintended on 1 July.

[6] He was returned to parliament in 1806 for Beverley, but in the following year made way for his son, Howard Vyse.

[9] Their sister Catherine in 1768 became the second wife of Sir George Smith, 1st Bart., was widowed in the following year, and died in 1786.

They had one son, who was a Lt Colonel in the Life Guards and one daughter, who was Maid of Honour to Queen Charlotte.