[1] Following the duo's 2018 and 2019 EPs,[2] I Dont Know How But They Found Me announced their debut studio album, Razzmatazz on August 5, 2020, alongside releasing its lead single, "Leave Me Alone".

[5] Weekes additionally cited his "distaste for all things Los Angeles" as an influence for the album's general tone.

In an interview with American Songwriter, Weekes mentioned David Bowie, Prince, and Don Henley as influences for the song.

[7] An acoustic piano version of "Leave Me Alone" was released on January 22, 2021, shortly before I Dont Know How But They Found Me began performing the song live on various shows.

Preceding each verse and chorus, a source code is run to make pre-timed lyrics appear with the song.

Social distancing, sterile isolation … it all seemed to fit with the song’s themes of wanting to quarantine yourself from toxic people and situations".