The album was named in reference to the success of 1992's New Miserable Experience, followed closely by the suicide of the former band member Doug Hopkins in 1993.

Reaction to Congratulations I'm Sorry was mixed, with some critics feeling that the music lay too close to the sound of the previous album.

AllMusic reviewer Stephen Thomas Erlewine explained that "the only fault of Congratulations...I'm Sorry is that it sounds a bit too close to the debut -- there's virtually no difference in terms of style and production.

"[3] People called the album "a quick fix for any dark mood", continuing, "the songs are so upbeat they almost conjure sunny summer afternoons.

"[7] Among tracks excluded from the album are "Seeing Stars", a song written by the lead singer Robin Wilson about the band's ex-lead guitarist Doug Hopkins, and the 1995 hit "Til I Hear It from You".