On 14 March 2024, Hozier announced his fifth EP Unheard that features four previously unreleased tracks taken from sessions for his third studio album Unreal Unearth (2023).
[4] The singer clarified that the songs "could not make the original release" for various reasons, but still fit the themes of "gluttony, limbo, violence and the outward 'ascent'".
[5] He first teased the song the same day on TikTok in a clip that features him drawing a sketch of a skeleton.
[7] "Too Sweet" sees Hozier meeting the "rhythm of a true night owl", sipping whiskey and drinking black coffee.
[8] Musically, Rolling Stone writer John Lonsdale described the song as "tough, catchy retro-R&B groove.