Following his 2019 album All My Heroes Are Cornballs, JPEGMafia set out to create a "swan song" for his final release with EQT and Republic Records.

Described as similar to American R&B artist Frank Ocean's 2016 releases of Endless and Blonde, this album, titled LP!

features a prominent sample of "Ain't No Need to Worry" by Anita Baker and The Winans.

In a review from Flood Magazine, Margaret Farrell praised the gospel sample vocal chops and the song's "woozy bass melody".

She also praised JPEGMafia's creative energy, lamenting its exclusion from streaming services, stating that it was a "shame because it’s really fucking good.

"[6] Writing for Pitchfork, Dylan Green called "Hazard Duty Pay!"