Duberry attended Enfield Grammar School in London and started his career at Chelsea where he was a trainee and made his debut during the 1993–94 season, before a brief loan period with Bournemouth.

Duberry picked up an Achilles tendon injury in January 1997 meaning he missed the rest of that season, including the 1997 FA Cup Final.

However, he again failed to break into the first team, as the likes of Jonathan Woodgate, Dominic Matteo, Lucas Radebe and Rio Ferdinand took Leeds to the Champions League semi-finals.

He did play the full 90 minutes of their memorable 1–0 win over AC Milan at Elland Road during that campaign;[6] however, this would prove to be his last appearance of that season in any competition.

The first season in which he played regularly for Leeds was 2003–04, as by this time Lucas Radebe had become increasingly injury-prone and crippling debt had forced the sales of Ferdinand and Woodgate.

However, Duberry failed to impress in a defence often made up of loan signings (such as Zoumana Camara and Didier Domi) and then youth-team players (such as Frazer Richardson and Matthew Kilgallon).

[7] On 31 January 2007, Duberry signed for Reading, who invoked a clause in his contract that allowed him to leave Stoke for a Premier League club if a set fee was received, rumoured to be in the region of £800,000.

[18] In August, 36-year-old Duberry underwent neck surgery in an attempt to prolong his career, and stated his hopes of a return to fitness within four months.