[1] On 7 November 1964, Loughton made his Football League debut for Colchester, in a 6–3 Essex derby loss against rivals Southend United.
Due to his father's ailing health, Loughton decided to drop into Non-League football in order to support the family business more.
Loughton, partnering former Brentwood teammate Brian Snowdon in the centre of defence, did not experience defeat with Chelmsford until his 14th game at the time, helping the club finish fifth in the 1970–71 Southern League season, playing in 49 of Chelmsford's 53 games that season.
During the 1972–73 season, Loughton missed just three of Chelmsford's 68 games in all competitions, as the club finished fourth in the Southern League, meeting Ipswich Town in the third round of the FA Cup.
[2][3] In July 1977, whilst still a player at Chelmsford, Loughton was appointed manager of the club, before leaving in May 1978.