Smith was editor and owner of Raleigh Register in Beckley, West Virginia.

His political career began in 1904, when, aged 24, he became mayor of Beckley, a post he held 25 years later in 1929.

Smith was elected to the United States House of Representatives from West Virginia's 6th District in 1928, where he served eight two-year terms (March 4, 1929 – January 3, 1945).

After leaving politics, Smith resumed his banking career and resided in Beckley, where he died.

His son Hulett C. Smith served as Governor of West Virginia.