Small was born on a farm in Temple Hills, Maryland, attended the public schools, and received technical education at the National Automobile College in 1914 and 1915.

He served in the Maryland House of Delegates in 1927 and 1928, and was a member of the board of county commissioners from 1930 to 1934.

From 1934 to 1942, Small was a member of the Republican State Central committee, serving as chairman for some of this time.

He was a member of the Maryland Racing Commission from 1937 to 1952, serving as chairman in 1951 and 1952.

Small died in Washington, D.C., and is interred in Resurrection Cemetery of Clinton.