Joined by Calle Löfgren on bass, Dennis Röndum on vocals, and Marcus Nilsson on lead guitar, they released a demo, Internal Decomposition.
After its release, Dewerud left Visceral Bleeding to focus all his attention on the band Spawn of Possession; he was replaced by Tobias Persson.
The band's second album, Transcend into Ferocity, came out in 2004, and after its release another member quit, this time vocalist Dennis Röndum, also to join Spawn of Possession.
While the band was writing the third album, Absorbing the Disarray, Nilsson decided that he needed to step back from the scene, as did Martin Bermheden.
After its release, Löfgren got married and had a daughter, and left for an undisclosed amount of time while Martin Andersson, former Eklöv filled in for him on the following tour with Deicide, Cryptopsy, and Skinless.