[2] In 1891, the Suwannee Rifles were organized in the Florida State Troops and designated Company D, 3rd Battalion of Infantry in 1892.

In June 1896 Captain George E. Porter assumed command while William Tedder continued as First Lieutenant.

At the start of the war with Spain, the twenty companies of the Florida State Troops were ordered to Tampa.

The Suwannee Rifles left Live Oak on 12 May 1898 under command of Captain William L. Tedder with 1LT L. K. Kemmerlin, 2LT Willie H. Lyle, and 2LT Archer B. Hays.

On 29 June the company detached from the Florida Regiment at Fort Brooke and marched to Tampa Heights, serving in the U.S.

The company left Tampa Heights on 21 July and traveled by train to Fernandina, arriving the next day.

While in Fernandina, Sergeant H. M. Hicks and H. D. Puckett separately deserted the company, and one soldier was discharged for "disability".

[4][5] Company E, under command of Captain William H. Lyle, was commended by the Adjutant General, Maj. Gen. Clifford Foster, for its actions in mustering and entraining within thirty minutes from receiving orders to assist the Suwannee County Sheriff, J. W. Hawkins.

Company E participated in the Louisiana Maneuvers at Camp Beauregard from 4 August through 24, 1940 and then mobilized for one year of training at Camp Blanding on 25 November 1940 under command of CPT Mahone Rees with Lieutenants Frank M. Green, Jr., Albert E. Durrell, Louie C. Wadsworth, and 1SG Chalmer T.

The company was under command of 1LT Burnice H. Bell, with 1LT Albert E. Durrell and 2LT Marvin A. Turner and 163 enlisted men.

Florida National Guard historian Robert Hawk noted in his book: "Few, perhaps none, of Company E's men from 1940 were serving with the Regiment in 1944.

In the course of the Second World War, no unit of the Florida National Guard had more men killed, wounded in action, or dead from other causes than Company E, 124th Infantry.

"[13] After the War, the unit reorganized on 8 October 1946 in Live Oak as Headquarters Company, 1st Battalion, 124th Infantry.