Milne was selected by the Hawks at pick 16 in the 2008 Rookie draft.
Played a key role as a defender in the Murray Bushrangers 2008 TAC Cup premiership team and represented Vic Country in the Under 18s competition.
In March 2011, Hawthorn promoted Milne to its senior list.
After being delisted at the end of 2011, Milne signed to play for Glenelg in the SANFL for two years.
In 2014 he crossed over to West Adelaide and played his last game on the interchange bench for the Bloods in the 2015 SANFL Grand Final clash with Woodville-West Torrens at the Adelaide Oval on 27 September.