In February 2014, the band supported Turnstile on their US headlining tour alongside Diamond Youth, Turnover, and Blind Justice.

On May 20, 2016, the band released their second album Rock the Fuck on Forever via Pop Wig Records, the label owned by Tripp, Fang, and Brendan Yates.

[8] The following month, on October 22, the band released their fourth album Yak: A Collection of Truck Songs via Roadrunner Records.

[15] With the album's announcement came Tripp officially launching a new line-up of the band, including several new members that had previously served as touring substitutes while McCrory, Fang and Yates were busy with Turnstile: rhythm guitarist Steve Marino, bassist Zechariah Ghosttribe, drummer Tommy Cantwell and lead guitarist Daniel Star.

In a new interview with Stereogum, Tripp confirmed that while both Fang and McCrory had made some contributions to the album and were still involved with the band to a degree, they had largely shifted out of the Angel Dust camp in order to focus full-time on Turnstile.

[25] In an article for Clash, writer Robin Murray described their music as "between a rough-around-the-edges Lemonheads with Elvis Costello vocal melodies".

[27] They cited influences including the Lemonheads, the Replacements, the Feelies[28] the Bad Brains, Violent Femmes and Greg Sage.

[26] Vocalist Justice Tripp has cited his main influences as James Ismean of Fury of Five and Iggy Pop of the Stooges.