The barony of Grove, with the manor of West Retford was part of the large property granted by William the Conqueror to Roger de Busli and is thus noted in Domesday survey, as "Grave".

Gilbrt's great granddaughter, Theophania, being a co-heiress, carried it to Malvesinus de Hercy, in the reign of Henry III.

During the wars between the Houses of York and Lancaster, the Hercy family, with their neighbours the Stanhopes, of Rampton, were active supporters of the House of Lancaster, and during the arduous struggle for superiority, were frequently surrounded by dangers of no common kind; till at length Victory "To Tudor's brow transferred the gem, The long disputed diadem."

To the south-east of this mount is a piece of ground, now almost level, where the traces of foundations are discernible; this is surrounded by a moat both wide and deep having formerly circumscribed a mansion or castle, but of which no definite remains are now in existence.

This place, as well as the one just alluded to, together with the greatest part of an extensive wood, are still circumvallated, and a trench or foss, in some instances double, may be distinctly traced for upwards of a mile.

It is generally acknowledged that this part of the country formed a portion of the settlements of the Coritani, but that in common with the rest of Great Britain, it became a prey to the Roman armies, who, in making the conquest, were necessitated to undergo considerable hardships and privations, and on obtaining possession, to cast up those fortresses and bulwarks, which, in almost every part of the United Kingdom, remain to the present time, as mementos of their bravery and determined perseverance.

In 1684, when the inclosures between the bridge and town were first ploughed up, many coins of Nerva, Trajan, Hadrian, Constantine, &c. were found, together with intaglios of agate, and cornelian, the finest coloured urns, and paterae, some wrought in basso relievo, with the workman's name generally impressed on the inside of the bottom; also a discus, or quoit, with an emperor's head embossed upon it.