Dilly Dally released three singles, one 7" ("Candy Mountain", 2014) and two full-length albums, Sore (2015) and Heaven (2018).

[4] The two self-taught guitarists were determined to start a band, and developed their sound through years of playing shows in the Toronto alternative and punk scenes.

In 2013, Benjamin Reinhartz (drummer) and Annie Jane Marie (bassist) joined the project:[5] the new musicians helped solidify the band's sound.

[7] After a positive Pitchfork review of the "Next Gold" single,[8] Dilly Dally's notoriety increased internationally.

The songs on this release cover themes such as marijuana use, queerness, depression and substance abuse in the music industry.

[19] On March 2, 2023, the band announced they were breaking up, saying "It's time for us to move forward and continue our journeys separately."

They released their last two singles, "Colour of Joy" and "Morning Light", and announced the date for their final concert on May 27 at Lee's Palace in Toronto.