Stone Age tribes lived on the site of Hartshill Castle around 10,000 BC and they were nomads, not travelling far, but wandering, always returning to this area for flints which they needed for tools and weapons.

Remains of Stone Age flints and bones of red deer and woolly rhinoceroses have been found in sand and gravel near to the river at Witherly, close to Hartshill Castle.

Hugh de Hadreshull built the first motte and bailey castle at Hartshill in 1125 to overlook Atherstone.

[4][5] The palisades were originally made of wood and, on top of the motte, was a wooden tower which was home to the Lord of the Manor and his family, as well as being a look-out post.

During the reign of King John (1199 - 1216), William de Hadreshull repaired the timber castle.