[1] Milne had a successful playing career with amateur side Morecambe, Preston North End, Liverpool (1960–1967), Blackpool (1967–1970) and Wigan Athletic (1970).

He made his debut in the 1–0 2nd Division defeat at Anfield by Southampton on 31 August 1960, he scored his first goal in the 10th minute of a 2–1 league win over Newcastle United at St James' Park on 20 September 1961.

Milne was selected to represent England at wing-half 14 times making his debut for Alf Ramsey's team in a prestigious friendly with Brazil at Wembley in a game that took place on 8 May 1963 and finished one-all.

A side containing Tommy Hutchison, Mick Ferguson, Ian Wallace, Terry Yorath, Graham Oakey, Bobby MacDonald and Jim Blyth played attacking football that swept many teams aside, often by large margins of victory.

After a spell as chief executive of the League Managers Association, Milne was employed as Director of Football at Beşiktaş JK Istanbul, Turkey in 2006.