"Punish Me with Kisses" is the second single by the English post-punk band the Glove from their sole studio album Blue Sunshine.

The Glove were a side project for Robert Smith of the Cure and Steven Severin of Siouxsie and the Banshees.

The band performed the song on the British TV show Riverside.

[7] In a review for the Blue Sunshine album for the Spanish-language magazine Muzikalia, critic Manuel Pinazo described this song and "Like an Animal" as having echoes of Syd Barrett.,[8] while Toronto Star, critic Ben Rayner described the song as a "more straightforward post-punk cut".

[9] In a review of the 2006 reissue of the Blue Sunshine album, which included a remix of the song, PopMatters editor Adam Besenyodi said that the depth of the album version "is lost on the Mike Hedges mix, where the full orchestration is supplanted with a tinnier sound".