The accompanying music video was directed by Michael Monaco and features Swindell at a bar giving tribute to a returning U.S. Special Forces soldier from Afghanistan.

Vickye Fisher of For The Country Record gave the song a negative review, criticizing the production and lyrics as well as Swindell's vocals, saying that "Unfortunately, the genuineness that they're going for with this one falls pretty flat.

"[1] Taste of Country reviewed it positively which stated that "Ultimately, 'Ain't Worth the Whiskey' is a strong choice for Swindell's third single off his self-titled debut album.

[4] Taking place in Nashville at the Silver Dollar Saloon, the video starts out with Swindell entering said bar with a blonde woman, presumed to be his ex, spotting him.

[5] Midway through the video, Swindell goes on stage to announce that Kyle Davis, a U.S. Special Forces soldier, has returned from Afghanistan and gives a salute to him by toasting a glass of alcohol.