He immigrated to the United States in 1855 with his parents, who settled near Plymouth, Ohio, where he attended the public schools.

He moved to Charlotte, Michigan, in 1867 where he engaged in agricultural pursuits and also worked as a mason.

He was president of the First National Bank of Charlotte in 1898 and also engaged in manufacturing and agricultural pursuits.

He was chairman of the United States House Committee on Labor in the Sixty-sixth Congress.

Smith was reelected to the Sixty-eighth Congress, serving from June 28, 1921, until his death in Charlotte.