A jeweller by trade, Small took an interest in politics from an early age, and in the 1830s was an organizer of the Locofocos faction of the Democratic Party.

After an interval in the 1850s as proprietor of a marine engineering facility—Brooklyn's West Street Foundry—Small joined the civil service, holding a wide variety of government positions over the course of several decades.

In 1835, Tammany Hall Democrats attempted to thwart an Equal Rights Party meeting by turning off the gas and plunging the venue into darkness.

[1][2] In about 1850, taking advantage of a business opportunity, Small acquired the West Street Foundry, a steam engineering works in Brooklyn.

[1][6] During his proprietorship, the company built the engines for at least 18 steam vessels, most notably that of Daniel Webster, one of the finest and fastest New England steamers of her day.

[7][8] Small's contacts through the foundry also led to him briefly accepting a position as captain of the New York steam ferry Boston, but he resigned after finding this line of work unprofitable.