The original members of the band were bassist Barry Clausen, guitarist Etienne Harris, drummer Duane Heydenreych and keyboardist Milandru Mapengo.
The band subsequently took on a three-piece brass section, in the form of The University of Cape Town's Simon Bates on saxophone, Jody Engelbrecht on trumpet and Ross McDonald on trombone.
The band released its first CD, More Fire, in South Africa in October 2003, and the song "Noh TV" won a National Bronze Stone award for best music video in that same year.
The Rudimentals have also performed at concerts featuring: Mad Caddies, Joe Sample, Randy Crawford, Groove Armada, Violent Femmes, Johnny Clegg, Freshlyground, Lucky Dube, Vivian Jones, The Wailers, The UK/English Beat and Jimmy Eat World, and The Prodigy.
Also in late 2014, The band released a 5-song EP entitled "Blaze Up the Fire" and the single "Sound Boy Killer" quickly rose to number 1 on the Nationally acclaimed 5FM Radio charts.