Initially called Sean Kelly and the Iron Dukes, they were formed by Sean Kelly (ex-Models, Absent Friends) on vocals and keyboards; and Geoffrey Stapleton (GANGgajang, Absent Friends) on keyboards and guitar.
They were soon joined by Michael Armiger (Paul Kelly and the Coloured Girls, The Go-Betweens) on bass guitar; Michael King (Absent Friends) on guitar and backing vocals; and John Mackay (Absent Friends) on drums and percussion.
[4] In December 1992 the band released its debut and only album, Harbour City, it was co-written and co-produced by Kelly and Stapleton.
[5] In 1993 they released the EP, I Fought The Law, three tracks from which also appeared on the 1993 soundtrack for the Yahoo Serious movie Reckless Kelly.
[1][6] On 23 September 1993 The Dukes performed "Faith" to 250,000 people at Circular Quay, minutes before Sydney was announced as the host city for the 2000 Summer Olympics.