[2] Carlile often played basketball and soccer as a junior before beginning his Australian rules career in his home town with the Wangaratta Rovers.

The big-bodied 192 cm and 98 kg Carlile was selected by Port Adelaide at pick 44 in the 2005 AFL Draft from the Murray Bushrangers.

He made his Australian Football League debut in round 16, 2006 in the match against St Kilda at Aurora Stadium.

He quickly become a stalwart in defence for his tight checking role and ability to run forward of the play.

He did however manage to poll the first Brownlow votes of his career [2 votes] after an outstanding display against Hawthorn [round 4] in which he kept Jarryd Roughead goalless to be a key player in Port's win against Hawthorn.