He then started Wallace & Lithgow, a metals company on Market Street in October 1836.

This building was designed by Henry Whitestone, a prominent Louisville architect whose firm exists today as Luckett & Farley, who also still possess the original drawings.

After Philip Tomppert was impeached by the City Council in 1866, that same body elected Lithgow mayor.

Lithgow was the chief director and president of the Mechanics' Fire Company in 1834.

[1][2] James Smith Lithgow died in Louisville on February 21, 1902, and is buried in Cave Hill Cemetery.