Produced by Brad Cook, the album features contributions from Conor Oberst, Meg Duffy, Anjimile and S.G. Goodman.

Front member Alynda Segarra started recording The Past Is Still Alive the month after the death of their father,[1] in March 2023.

[2] The album emerged from a period of "personal grief" and pulled inspiration from "radical poetry, railroad culture, outsider art", as well as works from Eileen Myles and activist groups like ACT UP and Gran Fury.

Tracks are viewed from the perspective of Segarra as "first-person lyrics" and reflects on key moments of their childhood, struggles in early adulthood and lessons learnt in the present time.

[5] Hurray for the Riff Raff promoted the album through a 39-date North America and Europe tour in early 2024.