Primarily a right back, Hoyte previously played for English clubs Arsenal, Sunderland, Middlesbrough, Millwall and Dagenham & Redbridge, as well as American side FC Cincinnati in both the USL and MLS.

[4] He progressed through the club's academy, and was an unused substitute in both legs of the final as Arsenal won the 2001 FA Youth Cup.

Hoyte played in the 2004 FA Community Shield, again from the bench, as Arsenal beat Manchester United,[9] and made his first senior start on 28 August 2004, away to Norwich City, as a last-minute replacement for centre-back Pascal Cygan who was injured in the warm-up.

[9] During the summer of 2005, Hoyte was linked with a loan move to Ipswich Town, but Arsenal manager Arsène Wenger made clear he wanted the defender to play Premiership football.

[14][15] When Clichy recovered, Hoyte moved back to his preferred right side of defence to cover for the injured Emmanuel Eboué.

[17] He finished the season with 36 appearances, a total that included a starting place in the League Cup final, which Arsenal lost 2–1 to Chelsea.

[15] In July 2007, the Daily Mirror reported that Aston Villa were set to make a £4.5 million offer to Arsenal for Hoyte, after manager Martin O'Neill prioritised bringing in someone to fill the right back position.

[citation needed] Wenger stated that Hoyte was not going anywhere, and with Éboué playing in midfield, he was in competition with Bacary Sagna for the right back position.

[19] Determined to stay and fight for his place,[20] the player turned down a move to Aston Villa,[21] but Arsenal were prepared to listen to offers.

On 8 February 2012, Hoyte was assaulted by a pitch invader during a live televised FA Cup tie between Middlesbrough and Sunderland.