Doyle was selected by the Swans under the father–son rule in the 1999 National Draft, as his father Robert had played 77 games for South Melbourne.
The tall ruckman made his debut in 2000, but recurring ankle and knee injuries meant that he did not manage to play more than three games in a row in his first four seasons.
In 2006, following the retirement of premier ruckman Jason Ball, Doyle arrived at the end of the season in working order.
Partnering Darren Jolly in the Grand Final, Doyle was the Swans better ruckman in their narrow loss to the West Coast Eagles.
For the 2007 season, the Sydney Swans recruited experienced ruckman Peter Everitt from Hawthorn to partner Darren Jolly, leaving Doyle to play in the reserves.