Born in Franklin County, Mississippi, to Dr. John Everly Holden and Laura (Curtis) Holden, he attended the public schools of Franklin County, and read law "in the offices of Col. T. R. Stockdale, C. E. Williams and Judge W. P. Cassady".

Holden gained admission to the bar in Mississippi in June 1894.

[1] He practiced law in the small town of Summit, Mississippi, for nineteen years, and served as its mayor for twelve years, becoming active in the state Democratic Party.

[2] Circuit Judge William Houston Hughes initially declared as a candidate for the seat in the following election, but after testing the electorate, withdrew.

[1] Holden died of pneumonia at his home in Jackson, Mississippi,[1] two days after his 55th birthday, and was succeeded on the court by the appointment of W. Joe Pack.