Smith never gained a regular place at Celtic Park and joined fellow Scottish side Dundee in August 1995.

He quickly established himself in the team at right-back and was made club captain in 1997, the same year Dundee achieved promotion to the Premier Division.

He also took on the role of joint caretaker manager (with Bobby Mann) for the final two games of the 2005–06 season following the dismissal of Alan Kernaghan.

On 4 November 2008, Smith returned to Dundee as U19 coach, with his registration as a player following in January,[3] whereupon he was loaned out to neighbours Brechin City, with the ability to be recalled at any time.

Brechin City's status as a part-time team enabled Smith to continue in his role as U19 Coach at Dens Park.

[6] His sacking was criticised by St Johnstone manager Steve Lomas, believing Smith deserved another chance.

[14] After leaving East Fife, Smith took over as manager of recently relegated Scottish League One side Raith Rovers on 30 May 2017.

[14] Rovers finished second in 2017–18 Scottish League One, narrowly missing out on automatic promotion and then losing in the playoffs to Alloa.

Smith made his return to Dundee a couple of weeks later, taking up a role in the club's academy headed by Gordon Strachan and Stephen Wright.

[21] Smith was appointed Jim Duffy's assistant at Scottish League One side Dumbarton in January 2020 after the departure of Craig McPherson.