Abhorrence was formed in early 1989 by guitarists Tomi Koivusaari (of Violent Solution and Amorphis) and Kalle Mattsson, vocalist Jukka Kolehmainen and bassist Jussi Ahlroth (latter three whom had played together in a band called Disaster), as well as drummer Kimmo Heikkinen.

The Completely Vulgar compilation consists of the band's demo and EP as partially remastered versions, as well as live recording from 1990.

The band formed to play in support of the live album's release, with Waltteri Väyrynen as drummer.

In early 2018 the band announced they had written some new music and made an agreement with Svart Records, regarding the release of an EP later in the year.

They performed some of the new material at concerts on 10.2. at Torvi Bar in Lahti and 24.3. at Kuudes Linja club in Helsinki, supported by Corpse Molester Cult.