White was born in Mason County, Kentucky, but moved to Ohio at a young age.

When the Civil War began, White enlisted in the 12th Ohio Infantry, being chosen its lieutenant colonel.

[2] The 12th Ohio was attached to Jacob D. Cox's Kanawha Division at the Second Battle of Bull Run and during the Maryland Campaign.

The regiment saw heavy fighting at Fox's Gap and fought again in the vicinity of Burnside's Bridge during the Battle of Antietam.

[3] White and Spencer's Scouts operated against Confederate partisan and guerrilla leaders in western Virginia, especially those under John S. Mosby.

In April 1864, White took command of the 2nd Brigade in George Crook's division of the Department of West Virginia.