He later moved to Youngstown to work in the lumber industry.

After managing the hotel, Kelsey became captain of the USS Chesapeake and later the General Harrison.

In 1848, Kelsey ran as a Democratic dark horse candidate due to his lack of political experience and defeated Charles Bradburn and Milo Hickox for the title of mayor.

Kelsey returned to the hotel business in 1849 until his retirement.

Kelsey and Sophia Smith had 7 children: Edgar (who died in infancy), Eugene, Antoinette, Theodore, Ada Helen, Josephine H., and Edgar A.