William the Conqueror gave the Padley estate to his supporter the head of the De Bernac family.

In July 1588, the hall was raided and two Catholic priests (Nicholas Garlick and Robert Ludlum) were discovered hiding within the walls.

Two weeks later they were found guilty of high treason (being ordained priests in England) and they were hanged, drawn and quartered in Derby.

William Fitzherbert inherited the estate in 1649 but hefty recusancy fines and family debts forced him to sell the hall, which gradually fell into disrepair.

A pilgrimage to Padley Chapel began in 1892 in honour of the executed martyrs and it still takes place in July each year from nearby Grindleford railway station.