Of that performance, singer Jeff Buckley (who was in attendance) was later quoted as saying, "He came to CBGB's Gallery and ripped it up...He killed 'em...The charm of it is that he's brought it into his own thing.

[4] Immediately after the record's release, Polonsky and his live band toured as the main support act for Frank Black for twelve weeks in North America.

In 2004 Polonsky released The Power of Sound, and he and his band supported Audioslave on their five-week North American club tour in the spring of 2005.

[9] In 2006, Polonsky formed the short-lived band Big Nose with Brad Wilk and Tim Commerford of Rage Against the Machine and Audioslave.

[14] Polonsky's second full length release of 2020, and seventh overall studio album, Power and Greed and Money and Sex and Death was written and recorded during the COVID-19 pandemic lockdown in the spring and summer of 2020.

It features guest appearances by Jane Wiedlin of The Go-Gos on vocals, and Hong Wang of the Kung Fu Panda soundtracks on erhu.

In 2021, Polonsky joined the band 7D7D, with Tim Commerford of Rage Against the Machine on bass and lead vocals, and Mathias Wakrat on drums.