Fraser began his career in Scottish minor football, appearing for Eaglesham Amateur and Blantyre Celtic.
Fraser's form attracted the attentions of English clubs and in September 1963 West Bromwich Albion manager Jimmy Hagan paid £23,000 for his signature.
[4] His final Albion game was a 2–2 draw against Chelsea in November 1970 before manager Alan Ashman sold him to Nottingham Forest for £35,000.
[4] He would later play for Walsall where he hit the headlines after he was red carded for fighting with Bristol Rovers' Kenny Stephens - a former Albion teammate.
The other five appearances were during a 1967 overseas tour that the Scottish Football Association decided in October 2021 to reclassify as full internationals,[5] which increased Fraser's cap tally from two to seven.