When the American Civil War broke out he volunteered for service in the Confederate States Army and was made captain of the Clayton Guards.

[citation needed] In 1874 he was elected as a Democrat to represent Alabama's 2nd congressional district in the 44th United States Congress.

After redistricting, he won a second term representing Alabama's 3rd congressional district in the 45th United States Congress.

Williams served as chairman of the Committee on Expenditures in the Post Office Department in the Forty-fifth Congress.

This article incorporates public domain material from the Biographical Directory of the United States Congress