They previously released an album titled The Death of a Dictionary and an EP titled Divided Mind, Divided Planet under the name Public Affection.

Two songs from this EP, "Operation Spirit" and "Good Pain" later appeared on their album Mental Jewelry.

The two other songs would later appear as b-sides to the European CD single for "Operation Spirit".

In 1994, Live released their second album, Throwing Copper.

Both Europe and Australia released 2-CD set editions of the album with Four Songs as the second disc.