Savage released solo albums entitled Nothing Broken (2000) & Wrong Man's Hands (2004) as well as a compilation called Rare Songs & Performances 1989–2004.

[6] Also in the 1980s he played in the Melbourne-based country-rock band, Dust on the Bible, with his sister-in-law Jane (Frank's wife) as lead vocalist.

[5] In 1988, with Last, he formed Dave Last and The Legendary Boy Kings, which included Bruce Kane on drums; Manny Markogiannakos on guitar; and Shane Walsh on bass.

Other members of the band included Rod Hayward on guitar and Chris Walsh ex of the Moodists (as were Dave Graney and Clare Moore).

Savage joined Nick Cave and The Bad Seeds in 1990 on piano, organ and backing vocals[4][5][7] to promote their sixth album, The Good Son (April 1990).

[4][7][8] Through the late 1980s and into the 1990s, he also guested on albums and singles for various fellow Australian musicians, including Kim Salmon, Dave Graney (My Life on the Plain, 1989), David McComb (The Message EP, 1991), Spencer P. Jones (Rumour of Death, 1994), and Robert Forster (I Had a New York Girlfriend, 1995).

[12] Savage's next solo album Wrong Man's Hands, released in 2004, was recorded from late 2003 to early the next year[15] on an 8-track in a room above the Union Club Hotel, Fitzroy, with members of Melbourne band The Stream, Amanda Fox and Robert Tickner.

[16] Savage's 2005 compilation album Rare Songs & Performances 1989–2004 traced his various studio and live material recorded in Australia and Europe.

He may not be blessed with the purest set of pipes, but his quivering, piano-led renditions of songs from his last four albums frame his ragged, whiskey-soaked vocals perfectly".

[18] In 2010, Savage, Fox and Tickner issued the six-track EP Pussy's Bow, which had been recorded in Ireland's Tumbleweed Studios in Dundalk in the previous August.

[19] I-94 Bar's Barman reviewed the EP "If, like me, you think of him principally as Nick Cave's piano player, then you need to take a deeper dive ... [it] blows away some of the preconceptions of him as solely a country artist or (gasp) a Goth ... [it] is nothing but a record of contrasting moods.

Conway Savage is credited with: organ, piano, keyboards, backing vocals, guitar, hand clapping, composer, producer.