They won the league in 1897–98, and the following season reached the final of the FA Amateur Cup again, this time winning 1–0 against Harwich & Parkeston.

In 1906–07 they won the Northern League again and reached the Amateur Cup final for a fourth time, losing 2–1 to Clapton.

They won the Northern League title in 1928–29, 1931–32 and 1932–33, also reaching the FA Amateur Cup final in the latter season, losing 4–1 to Kingstonian in a replay.

[1] In 1939 the club switched to the North Eastern League, but it was abandoned due to the outbreak of World War II.

They rejoined a reformed Midland League in 1972, but again left after a single season to play in the Northern Alliance before folding in 1975.