Born in Stamford in the Colony of Connecticut, after the American Revolutionary War his Loyalist family emigrated to New Brunswick, Canada, settling in a rural area on the west bank of the Missaguash River near the present-day town of Sackville.
Trained in medicine, Dr. Rufus Smith had a large practice, serving the residents across the Isthmus of Chignecto.
In 1817, he was elected to the 6th New Brunswick Legislative Assembly as a representative for the County of Westmorland.
Rufus Smith died in 1844 and is buried in the Methodist Church cemetery at Point de Bute.
His daughter, Diana Gay Smith, married Lestock P. W. DesBrisay, a businessman from Richibucto, New Brunswick who would represent Kent County in the Legislative Assembly of New Brunswick from 1856 to 1866.