During the 1850s, there was a river crossing near the present location of the town that was part of the Austin to Fort Belknap Military Road that was used by the 2nd U.S. Cavalry under command of Albert Sidney Johnston and Robert E.
[citation needed] The first settlers arrived in the 1870s and Eliasville was founded on land owned by J. L. Dobbs.
Former Dallas Cowboys linebacker Mike Dowdle was born in Eliasville, as were two University of Texas presidents, Harry Yandell Benedict and Homer Rainey.
Two early residents were the Donnell brothers, William and Thomas, who established a grist mill on the Brazos River on the west side of town.
The bed of the clear fork is sandstone in this area and made for a sturdy foundation on which to build a mill.