The village has a long history; it was documented in the 11th-century Domesday Book, and was home to the ancestors of Abraham Lincoln, 16th President of the United States.

[5] The village was the home of Richard Lincoln (1550–1620), a local churchwarden who built the building which is today The Angel public house.

[8] Richard Lincoln is buried under the centre aisle of St Andrew's Church in Hingham, Norfolk, a privilege reserved for the gentry.

In particular the aisles of the nave extend to embrace the tower, which is supported on three sides by unusually large arches.

All Saints is described by architectural critic Nikolaus Pevsner as "big and proud, and historically outstandingly interesting".

The Mill bakery has changed ownership and premises, and is currently owned by Budgens in Drayton, Norfolk and still continues production under the same name.

During the Second World War the first British and US combined bombing raid was launched from Swanton Morley on 29 June 1942, with Prime Minister Winston Churchill and Dwight D. Eisenhower present.

[3] The competition recognises villages that provide "a well-balanced, pro-active, caring community which has made the best of local opportunities to maintain and enhance the quality of life for all residents".

[16] Professor Swanton Morley, a character in Ian Sansom's comic thriller The Norfolk Mystery (2013) is named after the village.