Ruffles was recruited by Fremantle with selection 68 in the 2008 AFL Draft from the North Ballarat Rebels in the TAC Cup.
[3] Ruffles made his AFL debut at AAMI Stadium in Fremantle's match against the Adelaide Crows in Round 15.
[4] In July 2009, in his third game, Ruffles played in Fremantle's win over the West Coast Eagles in the 30th Western Derby, kicking 2 goals, but rupturing his left anterior cruciate ligament in the final minutes.
He was recalled again to the Fremantle side for their Round 21 match against Hawthorn in Tasmania, when many senior players were rested from the long trip.
On 13 October 2010, Ruffles was delisted by Fremantle, although as a contracted player for the 2011 season, he was later re-drafted onto the rookie list.