Baker grew up in Fremantle, Western Australia, with family roots stretching back in the port city for generations.

[2] In 1976 he travelled to the United States and then England, where he saw early live performances by the Ramones, Flamin' Groovies, the Dictators and Johnny Thunders.

[7] McFarlane declared that "Frantic Romantic" and The Scientists EP are some of "the most collectable artefacts of the Australian punk rock era.

"[7] The group toured the Australian east coast during December 1979 and again in February–March 1980; they also appeared on ABC-TV's pop music show, Countdown, performing "Last Night" from their EP.

[3][8] This resulted from: A chance meeting [by Dave Faulkner] with guitarists Kimble Rendall and Roddy Radalj at an end-of-1980 New Year's Eve party led to the formation of Le Hoodoo Gurus, with former Victims drummer James Baker rounding out the roster.Rendall left in 1982 just prior to the release of their debut single, "Leilani" (October), and was replaced by Clyde Bramley on bass guitar and backing vocals from Sydney bands, The Hitmen and Super K.[3][8] Radalj was next to leave the band as he was unhappy with Rendall's leaving and Faulkner's greater influence on the band's direction.

[13] Hoodoo Gurus iconic status on the Australian rock scene was acknowledged when they were inducted into the 2007 ARIA Hall of Fame.

[14][15] Baker joined the Beasts of Bourbon in September 1983, together with Tex Perkins (ex-the Dum-Dums), Spencer P. Jones (the Johnnys), and former bandmates Salmon and Sujdovic of the Scientists.

[13] This line-up was featured on the band's first album, The Axeman's Jazz(July 1984), recorded in a single afternoon in the previous October for $100, by producer, Tony Cohen.

"[13] In mid-1984 when the Scientists (with Salmon and Sujdovic aboard) left Australia to tour overseas the Beasts of Bourbon line-up of Baker, Jones and Perkins were joined by Shepherd and Stu Spasm on bass guitar (ex-Zulu Rattle, Salamander Jim) for their national Sultans of Swig tour.

[3][13] Baker provided lead vocals and drums for a single: a cover of the Troggs' track, "I Can't Control Myself" (June 1985), with an original, "Born to Be Punched" as its B-side.

Perkins' voice had matured into an authentic blues growl that showed the influence of Howlin' Wolf, Captain Beefheart and Tom Waits.

Early in 1991 Baker and Sujdovic left to be replaced by Brian Hooper on bass guitar and Tony Pola on drums – both from Salmon's new band, the Surrealists.

[3][13] In 1988 Baker joined another group, the Dubrovniks, alongside Radalj and Sujdovic together with Peter Simpson on guitar and vocals (ex-Teeny Weenies, Super K, Spectre's Revenge, Hoi Polloi).

[16] They released several albums: Dubrovnik Blues (August 1989), Audio Sonic Love Affair (September 1990), Chrome (June 1992) and Medicine Wheel (1994).

[16] On 10 February 1995, the 1980s line-up of the Scientists: Baker, Juniper, Salmon and Sharples, reformed for a one-off show in Perth.

[17] They played support slots in Perth for the Fuzz, Little Birdy, The Panda Band, Brian Hooper, Pharaohs, and Beasts of Bourbon.