"This district includes nine parishes and forms a subdivision of the Hundred of Wangford, anciently called the liberty, manor, or township of South Elmham.

It was granted by Sigebert [Sigeberht], King of the East Angles [Anglia], to Felix the Burgundian, his first bishop, who fixed his see at Dunwich in 630 A.D.."[10] Several parish churches were founded here in Saxon times, All Saints being one of them.

During the reign of Henry VIII the seat was seized in exchange for other lands.

It was then conveyed to Sir John Tasburgh, Knight, 20 May 1613, the manor with the rectories and all the demesnes.

The descendants of Sir John retained the lordship of South Elmham until the male line died out and it was passed to the Wybornes.

[10] The church is constructed in flint with freestone dressings, and has a lead roof.

Its plan consists of a continuous nave and chancel, with a south aisle which runs along the whole length of the nave and chancel, a south porch, and a west tower.

The porch dates from the medieval period, but the south doorway is Romanesque Revival from the Victorian era.