During 1999–2000 Gould generally remained the first-choice goalkeeper at Parkhead despite the arrival of Dmitri Kharine, and picked up another Scottish League Cup winner's medal when Celtic defeated Aberdeen 2–0 in the final on 19 March 2000.
Another highlight that season was saving a penalty from Ronen Harazi in a UEFA Cup tie against Hapoel Tel Aviv to help his side progress.
Despite his lack of first-team football at Celtic thereafter, Gould remained at the club for a further 3 years having been offered an extended contract by the manager, before eventually joining Preston North End on a free transfer in January 2003.
[8] It was during this time at Preston that Gould enjoyed a renaissance in his form which resulted in a call-up into the Scotland Squad for the European Championship play-off games against Holland.
[10] After an outstanding season at Celtic, he was called up to the international side for the 1998 World Cup but was third choice behind Jim Leighton and Neil Sullivan.
After the competition he remained in the squad deputising for Sullivan and won his first cap on 9 October 1999 in a 3–0 win over Lithuania at Hampden in a qualifier tie for UEFA Euro 2000.
His form at Preston North End a couple of years later won him a recall to the squad in November 2003 for the two-legged Euro 2004 qualifier against the Netherlands,[11] albeit he did not play in either game.
After two seasons with the Phoenix both of which resulted in the club reaching the finals series, Gould left to join Perth Glory and work alongside his former Rangers adversary Ian Ferguson.
It was announced on 26 April 2012 Gould was returning to New Zealand on a two-year deal to continue his previous role as goalkeeping coach with the Wellington Phoenix.
[13] On 16 February 2015 Jonathan Gould joined West Bromwich Albion as their first-team goalkeeping coach, working for manager Tony Pulis.