In the Domesday Survey of 1086, where the manor of Campesia was flourishing and covered some 200 acres, while Esca was smaller neighbouring settlement.

Granted by William the Conqueror to his supporters, their holders included Alan Rufus, Lord of Richmond Robert Malet, Hervey de Berre and the Bigod family, the latter being relatives of the King.

The possession and tenancy of the lands, including the small Manor of Ashe, underwent various permutations during the succeeding centuries, by death, reversion to the crown, inheritance and marriage.

Passing through the hands of the Plantagenets, Segraves and de Mowbrays, it merged into the lands of the Fitzalan and Howard clan, to become Dukes of Norfolk.

The Priory, founded in 1195, ended its days abruptly in 1536 with the Dissolution and much of its lands and other property was granted to Sir William Willoughby of Parham, who had gravitated to the honeypot represented by the household set up for Henry FitzRoy, 1st Duke of Richmond and Somerset, illegitimate son of Henry VIII, who died on him in July 1536.

The Priory property was then subject after 1536 to sale through a string of owners, including the Lane family, the Scotts and the Loudhams.

The property passed in 1912 to Lowther's son, James, Speaker of the House of Commons from 1905 until 1921, created subsequently Viscount Ullswater of Campsea Ashe.

After repeated sales following the Second World War, Ashe High House fell into ruin and only the foundations now survive.

The former Rectory, a handsome Georgian house, situated on the west-side of the churchyard, is first mentioned in 1765 but it is likely that the site was occupied by a parsonage prior to this.

The Priory housed as a nun for several years in the 14th century the redoubtable and well-connected Maud of Lancaster, Countess of Ulster but despite these auspicious times, like all other monasteries in England it was confiscated by the crown for financial gain under Henry VIII, the nunnery being in effect forced to close in 1536.