It was first released on their 2008 EP titled Complicated before being remixed and re-released on February 4, 2013, as their second single for Stoney Creek Records.

Carolina was originally written in 2007 when Parmalee flew down to Georgia to write with producer Rick Beato.

Beato was recommended to them by a mutual friend in the music industry, so singer Matt Thomas found his phone number and called him up.

Thomas then picked up an acoustic guitar and showed him the beginning of a chorus that was part of a song idea they had come up with recently.

Dukes wrote that "the chorus is as good as anything you’ll hear in 2013," but added that "the production feels too soft for a group of former rockers.

"[5] Chuck Dauphin of Roughstock gave the song a favorable review, writing that "the harmonies are nothing short of incredible.