Joliffe was the eldest son of William Jolliffe (1745–1802) of Merstham and his wife Eleanor, daughter and heir of Sir Richard Hylton, 5th Baronet, of Hayton Castle in Cumberland.
In 1804 he married Elizabeth Rose, the illegitimate daughter of Robert Shirley, 7th Earl Ferrers.
The couple had no children, but Joliffe fathered two illegitimate sons.
This article about a Member of the Parliament of Great Britain (1707–1800) representing an English constituency is a stub.
You can help Wikipedia by expanding it.This article about a Conservative Member of the Parliament of the United Kingdom representing an English constituency and born in the 1770s is a stub.