[3] During the 2013–14 season, he joined Northern Premier League Division One North club Radcliffe Borough on a work experience loan.

[4] After leaving Fleetwood, he had spells with Padiham, AFC Blackpool and Clitheroe, before stepping up two levels to sign for National League North club FC United of Manchester in May 2018.

[5][6] On 3 June 2019, despite FC United's relegation, Willoughby stepped up another level to join National League club AFC Fylde.

[9] During his time with AFC Fylde, Willoughby attracted interest from multiple Football League clubs, including Bolton Wanderers, but a move never materialised.

[13][14] On 7 June 2023, Willoughby joined National League club Oldham Athletic, signing a two-year deal.