He remained in the first team for several years, making over 150 appearances in all competitions for the club before joining Hereford United in 2012 after an initial loan spell.

[9] After captaining the club's reserve side, Anthony was called into the senior team for several pre-season friendlies at the start of the 2004–05 season, featuring in a match against Chester City.

[12] In February 2006, Anthony joined Football Conference side Forest Green Rovers on a one-month emergency loan deal,[13] He made his debut in a 3–2 defeat to Morecambe.

[19] Despite being restricted to twenty-three appearances in his first season, due to a knee injury,[20] Anthony signed a contract extension with Rovers, keeping him at the club until 2009.

[21] Forming a partnership with the club's established defensive players Craig Hinton and Steve Elliott, Anthony was part of a Rovers defence that conceded fewer goals at home than any other League Two side during the 2006–07 season.

Finishing in sixth place, the team won promotion after defeating Shrewsbury Town in the 2007 Football League Two play-off final.

[22] Anthony remained a regular in the first team following the club's promotion and scored his first and only goal of the 2007–08 season on 1 September 2007, at home in 2–2 draw with Nottingham Forest.

[28] After serving his second suspension of the season, he fell out of favour before making a goalscoring return to the starting line-up, in a 2–0 home victory against Oldham Athletic on 24 February 2009.

[38] Having initially retained his place in the side, scoring his second goal of the season in the 6–1 rout against AFC Totton,[39] he was dropped by new manager Mark McGhee who had been appointed as Paul Buckle's permanent replacement in January 2012.

[44] His loan spell with Hereford was later extended until the end of the season.,[45] finishing the season with fifteen appearances for the club as they suffered relegation from the Football League.

[49] The dismissal resulted in a three-match suspension and four days after the game, on 26 September 2012, he was released from his contract with the club in order for a loan replacement to be signed.

[50] Following his release, Anthony joined his home town club Newport County on trial before signing a permanent deal on 16 November 2012.

[57] On 6 August 2013, Anthony suffered a double ankle break during Newport's 3–1 Football League Cup victory at Brighton & Hove Albion after a tackle by Iñigo Calderón.

[58] Calderón received a straight red card for the foul but Newport manager Justin Edinburgh stated his belief that no malice was involved and dedicated the club's victory to Anthony.

[61] Anthony returned to the team and played a number of games towards the end of the 2013–14 season but Edinburgh later admitted that there were still concerns over his recovery after he developed back problems, commenting "I think there's always a doubt in terms of the severity of the injury.

[68] Anthony joined former club Bristol Rovers in September 2020 as an academy coach having recently passed his UEFA Pro License and would be working alongside the Under-14s team.