In 2003, he transferred to Northampton Town, and a year later, he left the Football League for the second and final time, signing with Forest Green Rovers.

Lyttle was a member of the team that won instant promotion back to the Premier League in the 1993–94 season, finishing second in the First Division.

Forest, however, lost some other players, noticeably Lyttle's defensive partner Stuart Pearce, who joined Newcastle United.

Lyttle vied for the right-back berth alongside French import Thierry Bonalair, and he left to pursue his career elsewhere at the end of the season.

In March 2000, Lyttle was sent on loan to West Bromwich Albion for the remainder of the season, signing just two days before the transfer deadline.

He was a regular in the squad during the 2000–01 season, employed by manager Gary Megson as a right-wing-back, and combined well with Ruel Fox down the right-hand side to help Albion reach the play-offs.

In May 2010, Lyttle confirmed that he had applied for the vacant AFC Telford United manager's job following the dismissal of Rob Smith;[12] however, former England international winger Andy Sinton was instead appointed.

[13] Following the departure of Tamworth manager Gary Mills and assistant Darron Gee to York City on 13 October 2010, Lyttle was announced as caretaker player-manager.

[14] The following day Lyttle brought in former West Bromwich Albion and Tamworth teammate Bob Taylor as a coach to assist him.

[15] Despite failing to find victory in his five league games, he was appointed manager on a full-time basis on 30 November after leading the club into the Second Round of the FA Cup with wins over Grimsby Town and Crewe Alexandra.

[17] Lyttle left his position as he felt it was untenable after claiming the club's board tried to bring in former York manager Martin Foyle as an adviser for the remaining four games.

[18] Lyttle returned to football as manager of Hucknall Town, replacing Tommy Brookbanks at the Northern Premier League Division One South club on 13 October 2011.