He was the eldest son of wealthy land owner Leroy Stafford and his second wife, Elizabeth Calliham.

[1][2] The Staffords had ten children—George Waters, Sally, Elizabeth Eloise, David Theophilus, Cornelia Knox, Julia Laura, Jesse Wright, Rosalind, Leroy Augustus Jr., and Kate Keary.

He enlisted in the "Rapides Volunteers" (Company E, 3d Louisiana Infantry Regiment)[1] and later served in Captain Ben McCullough's Texas Rangers.

Gen. William E. Starke early in the Battle of Antietam, Stafford was elevated temporarily to command of the brigade.

In October of that year, he was promoted to brigadier general and assigned command of the 2nd Louisiana Brigade.

The Gen. Leroy A. Stafford Camp #358 of the Sons of Confederate Veterans in Alexandria, Louisiana, is named in honor of the fallen general.