Kemper was educated at his father's private boarding school and later attended the University of Virginia, graduating with a law degree.

[5] They had seven children, including: In 1861, Kemper enlisted in the Confederate States Army during the Civil War, attaining the ranks of first lieutenant and captain.

Beauregard in his dispatches to the Confederate States Secretary of War, where he wrote, "Too much praise cannot be bestowed on [his] zeal and energy.

[7] After the Civil War, Kemper moved to Alexandria, Virginia where he practiced law and served as a notary.

[11] From 1885 to 1889, Kemper served as private secretary on the staff of Joseph E. Johnston, U.S. Commissioner of Railroads in the Cleveland Administration.