It was written by Lindy Robbins, Jess Cates and Emanuel Kiriakou, and produced by Matt Serletic.
Hicks said that fan reaction contributed to releasing it as a single instead of "The Runaround", as originally planned.
[1] The video starts with a black-and-white vision, then shows Hicks performing with the band.
AllMusic's Stephen Thomas Erlewine put "Just to Feel That Way" alongside "Places I've Been" and "Wherever I Lay My Hat" as being "professional and pleasant" cuts from the record, calling it "plodding yet anthemic" with Hicks delivering "just enough personality".
[2] A writer for Billboard praised Hicks for delivering "a powerhouse vocal that goes from coarse growl to cool-guy sensitivity", and called the track "more convincing than most anything he sang on the show.