[2] Failing to make the first team Scott was released by Micky Adams after a breach of his contract[3] in 2001.
On leaving Brighton & Hove Albion he joined Dover Athletic on a free transfer[4] Ramsay played 13 games at Dover Athletic scoring only a single goal in a five-month spell before transferring back to East Sussex signing to Eastbourne Borough, who were then in the Southern League.
[5] In 2003, Brentford sparked an interest in signing Scott for £25,000 after scoring 33 goals in the 2002/2003 season.
[7] In the six years at Eastbourne Borough, Scott bagged 135 goals in 283 appearances,[8][9] and helped the sussex side win the Sussex Senior Cup in 2002 and into the FA Cup first round in 2006[10][11] for the first time in the club's history.
[12] In June 2008, Ramsay left Eastbourne Borough after failing to agree to a new contract, signing for Hastings United, who "beat off competition from several higher league sides", such as AFC Wimbledon and Havant & Waterlooville to sign the prolific striker.