Born near Carlisle, Pennsylvania, Williams attended the common schools and received a very limited education.

He served in the Union Army as commandant of Camp Allen in Fort Wayne, in 1862 and as paymaster of Volunteers, with headquarters at Louisville, Kentucky, until the close of the war.

He served as chairman of the Committee on Expenditures in the Department of War (Fortieth through Forty-third Congresses).

In 1882, Williams was appointed by President Arthur as Chargé d'Affaires to Paraguay and Uruguay and served until July 21, 1885.

This article incorporates public domain material from the Biographical Directory of the United States Congress