The earthworks and ruins at North Elmham stewarded by English Heritage are thought to be the remains of Bishop Herbert de Losinga's late 11th-century episcopal church and the late 14th-century double-moated castle built on this by Henry le Despenser, Bishop of Norwich.

Henry came from a powerful family who had strong links with the House of Plantagenet and the notorious 'favourites' of King Edward II.

North Elmham railway station once served the village on the line from Wymondham to Fakenham East.

A section of the line, between North Elmham and County School station, includes a permissive footpath.

By the 1970s the milling machinery was driven by mains electricity while the turbines were used to drive a sack hoist and two mixing machines.