[8] Since then, all of the band's albums[9][10][11] have featured his vocals which have been described as "tortured laryngitis screams",[9] an "indecipherable ranting",[10] and "the utmost sickening, puke-ridden audio atrocities that could actually prove deadly if taken in large doses".

At the time, he was living in Clinton Hill, Brooklyn in New York City so he had to travel between there and New Orleans, Louisiana frequently for the recording sessions,[7] which took place at Side One Studios.

[7] The studio owner reportedly called Century Media to ask if the band were insane, and threatened to kick them out because of this.

[13] In 2006, he began a hardcore punk band along with Phil Anselmo named Arson Anthem,[15] in which he is the vocalist.

[16] Williams stated in 2008 that his desire with this band is to make people explore early hardcore punk.

[6][4] Early 2013 saw the emergence of Corrections House, an industrial project involving Williams plus members of Neurosis, Nachtmystium, and Yakuza.

[4] When Hurricane Katrina hit New Orleans on August 29, 2005, Williams was at his home in the Lower Garden District with his then-girlfriend.

[22] In the 2020 book Raising Hell: Backstage Tales from the Lives of Metal Legends, Williams stated he looted a pharmacy after the hurricane and "didn't get busted until three days later".

[23] Inside the house they could hear gunshots and at one time, upon leaving the apartment, Williams' partner was confronted by a person who attempted to rob her.

The following morning they borrowed a car and traveled to Morgan City, Louisiana, where Williams received word that his house had burned down.

[22] A fund to help to free Williams was created and his bandmates encouraged fans to send letters to him while he was in jail.

His excessive drinking eventually led to health problems, which resulted in him requiring a liver transplant.