The EP contains three new songs, as well as live renditions of "Make Me Wanna Die" and "Since You're Gone"—originally included on the band's debut studio album, Light Me Up (2010)—which were recorded at London's Hammersmith Apollo on November 4 and 5, 2011.

[1] In support of the EP, The Pretty Reckless embarked on a North American tour called The Medicine Tour in March and April 2012, followed by dates on Marilyn Manson's Hey Cruel World... Tour in April and May 2012.

[1] Robert Copsey of Digital Spy praised the EP as "a collection of wonderfully salacious and unashamedly bare-faced songs that today's charts are sorely lacking.

"[3] Stephen Thomas Erlewine of AllMusic viewed the three new songs on the EP as "harder and better than much of [the band's] guilty-pleasure debut, Light Me Up", concluding, "Sure, former child actress [Taylor] Momsen may just be acting out her teenage rebellion on a large stage and her imagination may be limited, but she is not insincere and the heartfelt tawdriness of Hit Me Like a Man is oddly compelling.

"[2] All tracks are written by Taylor Momsen and Ben Phillips, except where notedCredits adapted from the liner notes of Hit Me Like a Man EP.