[2] Noted for their "lyrically dense storytelling,"[3] and classic rock influences, the band's narrative-based songs frequently address themes such as drug addiction, religion and redemption, and often feature recurring characters based within the city of Minneapolis.

Formed four years following the breakup of Finn and Kubler's former band, Lifter Puller, The Hold Steady released the debut album Almost Killed Me in 2004.

To coincide with each event, The Hold Steady released stand-alone singles, marking the first recorded material of the six-piece line-up.

Working with producer Josh Kaufman, the band released their seventh album, Thrashing Thru the Passion, in 2019, followed by Open Door Policy and The Price of Progress in 2021 and 2023, respectively.

In 2003, Minnesota-raised singer, writer, and guitarist Craig Finn and New York City bartender and bassist Galen Polivka began talking about starting a band.

"[4] The Hold Steady's 2004 debut album Almost Killed Me, released on Frenchkiss Records, was a sleeper hit among music critics, reaching No.

It is a loose concept album following the exploits of a character named "Holly" (short for "Hallelujah") and her quest to find a balance between Catholicism and rock and roll through drugs and a metaphorical resurrection.

Pitchfork Media's Scott Plagenhoff wrote of the album, "[Craig Finn] not only has a commanding, rousing voice but he also says something worth hearing, displaying gifts for both scope and depth that are all too rare in contemporary rock—indie or mainstream.

[7] In 2007, the band recorded a modified version of "Take Me Out to the Ballgame" to be played during the seventh-inning stretch at Minnesota Twins home games.

The album was recorded in Hoboken, New Jersey and Wild Arctic studio in Queens, New York with producer John Agnello during January and February that year.

Guests on the sessions included Ben Nichols from Lucero, J. Mascis of Dinosaur Jr., Emilyn Brodsky, and Doug Gillard, who played guitar in Guided By Voices.

"[9] The album is more expansive than previous releases, including talk-box solos, harpsichord, and tuneful vocals (the notoriously gruff-voiced Finn started taking voice lessons).

[16] The band's subsequent tour featured additional musicians Steve Selvidge, formerly of Big Ass Truck and Bloodthirsty Lovers, on guitar and Dan Neustadt, of In Cadeo and The World/Inferno Friendship Society.

"[2] In July 2011, during a five-month break from the band, Finn recorded a solo album, Clear Heart Full Eyes, that was released in January 2012.

The recordings were the first to feature the full six-person Hold Steady line-up and were produced by Josh Kaufman, who had worked with Craig Finn on his solo material.

On June 18, 2019, the band announced their seventh album, Thrashing Thru the Passion, which collected several of the previously released singles alongside new Kaufman-produced recordings.

[21] Released to critical acclaim, it was their first Billboard top-ten record,[22] receiving end-of-year accolades from AllMusic, Uncut, Double J and God is in the TV by appearing on their top albums of 2021 lists.

[29][30] The Hold Steady appeared in the Season 3 finale episode of Showtime's Billions series as themselves performing at a party for Axe Capital.

The Hold Steady has been honored with a star on the outside mural of the Minneapolis nightclub First Avenue,[31] recognizing performers that have played sold-out shows or have otherwise demonstrated a major contribution to the culture at the venue.