A Welsh-language version of the song, "Gwe", was recorded as a session for Radio Cymru on 8 April 1993, and subsequently released in 1995 on an Ankst compilation album.
The location was chosen as band member Paul Jones was familiar with it, and Rough Trade had indicated that they would only release the single in September 1994; the band had only been informed of this the month prior.
[3] "Whale" was later re-released as part of the compilation album, The Sublime Magic of Catatonia.
[5] "Whale" was selected as NME magazine's single of the week, calling it a "breathy pop classic, loose-limbed and groovy".
Further comparisons were made to popular Britpop band Oasis.