The Inn was originally built in 1824-25 by John McKinney, a local lawyer and businessman, to compete with the tavern operated by the founder of Rogersville, Joseph Rogers.

Rogers' Tavern was originally located a few hundred feet off the Great Stage Road that ran through the new town to Knoxville, Tennessee toward the Cumberland Gap.

In 1823, he began construction on a massive, three-story, Federal style building that would house facilities for a true tavern bar, but also individual guest rooms on the different floors.

McKinney, the Inn's owner, saw this as a publicity coup over rival and town-founder, Joseph Rogers, who had also petitioned the President to stay at his Tavern.

Early in the war, Union forces captured the town, and during their occupation, they set their headquarters in the Hale Springs Inn, which was on the south side of Main Street, but faced north.

In 2003 the Rogersville Heritage Association purchased the inn and, in cooperation with city government, launched a renovation effort which surpassed US$2.1 million as of early 2009.