He was born in Springfield, Massachusetts, the son of Luke Bliss and Mercy Ely.
Bliss was educated at Harvard College, studied law in Boston and set up practice in Wilbraham.
He travelled to England near the start of the American Revolution, and was subsequently named in the Massachusetts Banishment Act of 1778.
With Ward Chipman, he was elected to the 1st New Brunswick Legislative Assembly after the sheriff closed the polls early and disallowed votes for opposing candidates.
He purchased a large home in Saint John formerly owned by Benedict Arnold.