Its members were recruited in the counties of Patrick, Wythe, Nelson, Bland, Floyd, and Grayson.

During the winter of 1861-1862, Wharton's men were transferred with Floyd to Tennessee just in time for the Confederate surrender at the Battle of Fort Donelson, where the 51st escaped and marched back to Nashville with 274 men, and eventually back to Virginia in spring 1862.

In June 1861, D. Lee Ross mustered a company of local citizens on his farm in Patrick County, Virginia.

97 men volunteered and elected D. Lee Ross as Captain, and William T. Akers, Abner J. Harbour and C.F.

On July 24, the units left Patrick County and set out for Christiansburg where they boarded the Virginia and Tennessee Railroad to Camp Jackson in Wytheville in order to enlist in the Confederate Army originally as companies C and F of the 51st Regiment, Virginia Volunteers commanded by Colonel Gabriel C. Wharton, VMI class of 1847.

Co. B, Wharton Grays; formerly called Co. H; enlisted July 31, 1861, for one year; joined regimental August 14, 1861; reorganized May 6, 1862.

Captains: David Lee Ross (to April 1862), William T. Akers (to Major, 1864), Rufus J. Woolwine.

Captains: Samuel H. Newberry (not re-elected; reappointed May 29, 1863), William G. Repass (resigned February 6, 1863).

Captains: Ezekiel Young, Calvin H. Senter (resigned, 1862), William C. Bourn (wounded, 1864) Co. K, Capt.

Captains: Stephen Mills Dickey (to Major, May 26, 1862), William A. Cooper (resigned, January 25, 1865).