Several small, independent Mississippi cavalry companies were combined in late 1862 to form the 4th Regiment under the overall command of Colonel C.C.

After they were combined, the separate companies of the 4th Regiment often operated as independent units while on assignment to different parts of the state to oppose raids by Federal troops.

The Copiah Horse Guards also known as Norman's Company of Partisan Rangers was mustered into service at Hazelhurst on March 1, 1861.

[3] In November 1862, Terrell's company captured a Federal steamboat, the Lone Star, near Plaquemine, Louisiana.

Near Baton Rouge, Louisiana, the Regiment's camp was hit by an unexpected early morning attack by Grierson's troops, with several men taken prisoner.

[8] The 4th Cavalry took part in raids and skirmishes against the Federal rear during the Siege of Port Hudson, May - July 1863, including the Battle of Plains Store.

[3] The 4th Regiment was assigned to Wirt Adams' Brigade in January 1864 and fought several skirmishes during the Meridian campaign.