As a musician, Baxter was the lead vocalist of Ghetto Blasters, Big Fans of Jesus, the Hollow Men and has also worked as a solo artist.
[2] He was a vocalist for Ghetto Blasters from 1982 to 1984 with Archie Cuthbertson, Kevin Fleming, Don Morrison and Nigel Sweeting.
[3] Baxter and Fleming then formed Big Fans of Jesus (1984–1985) with Allan Brooker, Ian Hill and Steve Watson.
[1][9] The Age's Jenny Brown felt the program displayed "[a] patchwork of rarely heard records and off-the-wall novelty tracks" and Baxter was described as "not terrificly tall but the frontman of a rock band in rehearsal".
[4][9] After his stint on 3LO he became a long term member of Coodabeens Footy Show on Radio National via 774 ABC Melbourne.