Potter was born in Cradley Heath and played for his local side before signing for Aston Villa in July 1959.
Originally an inside forward, he made his debut as a goalkeeper, replacing the injured Nigel Sims in a League Cup tie away at Plymouth Argyle in December 1960[2][3] going on to play in three First Division games over the festive period whilst Sims was injured - including two derbies against Wolverhampton Wanderers and one FA Cup tie, against Peterborough United.
In 1966 he moved down into non-league football with Burton Albion, winning the Player of the Year award for the 1969–70 season.
Potter was the goalkeeper in Hereford's FA Cup run of 1971–72, notably defeating Newcastle United in the Third Round.
Icke was forced to retire with arthritis in his knees, but Potter subsequently broke his leg on the opening day of the season.