In late 2002, producer Michael Squid joined the group and together they completed their self-released album Thug Paradise 2.1, released in 2003.

Subsequent to the release of this album the band spent much of the next following years touring both the United States and the UK, both playing shows of their own and also in a supporting role for various artists.

[24] The sample was taken without the permission of the band who are now seeking compensation from Mad Decent records for the copyright infringement, along with Reggaeton artist Héctor Delgado,[25] due to the success of the release.

[24][28] The original lyrics ("And if you bring a 40 bottle to battle me/ I'll just punch you in the face/ then do the Harlem Shake") were a reference to a fight Musson had with a local graffiti artist after a Plastic Little gig.

[3] Plastic Little list a wide range of artists as their influences, including The Roots,[32] Yellowman,[9] Three 6 Mafia, Bonnie Raitt, Dwight Yoakam, Sade, R. Kelly and even Disney.