In his later career he had shorter spells with Dundee United, in Australia (spending a season with Parramatta Power in the NSL), Raith Rovers, Clydebank and Clyde, moving into coaching with the latter.

Miller was raised in the East End of Glasgow, attended St Mungo's Academy[1] and grew up supporting Celtic;[2] his father (also Joseph) had been a professional footballer with Hamilton Academical and Swindon Town.

[3][1] After moving to Pittodrie Stadium in summer 1983, Miller made his Aberdeen debut just after his 17th birthday, coming on as a substitute in a league fixture against Dundee United in December 1984.

[3] He played one more full season for the Dons with his form attracting attention from around Europe – Miller has stated teams from Spain and Italy showed an interest in signing him,[3] along with Liverpool who were coached by his childhood hero Kenny Dalglish,[1] and Manchester United where Alex Ferguson was now the manager.

[11] Playing as a right winger providing chances for forwards such as Mark McGhee and fellow new signings Andy Walker and Frank McAvennie,[13] the side won the league and Scottish Cup double in 1987–88, their centenary season;[11][6] Miller has described this as his "best memory".

[2] Celtic failed to keep their grip on the league title in 1989, dropping to 3rd place as Old Firm rivals Rangers began what would be a period of dominance, and were also eliminated from the European Cup by Werder Bremen.

[2] However the Hoops were able to retain the Scottish Cup, with Miller scoring the winning goal in the final against Rangers at Hampden Park to end their hopes of a treble.

[19] Although Aberdeen were no longer the dominant force in Scotland as when he first joined in 1983, when Miller returned a decade later they were at least as strong a team as Celtic, having finished runners-up behind Rangers in three of the last four seasons.

[2] He contributed 33 appearances – many from the bench – and two goals in his single season at Tannadice Park in which the team finished in mid-table and reached the Scottish Cup semi-final, being beaten by Celtic.

He never received a full cap for Scotland, with the tactics of the time under coach Andy Roxburgh rarely utilising wingers, plus a direct rival in Pat Nevin and several competitors for a place as a striker.