The ruins of this important Norman and medieval castle, built within the former manor of Elmley, are located on the flanks of Bredon Hill, 1/2 mile to the south of the village to which it gives its name.

[1] The castle is believed to have been built by Robert le Despenser d'Abetot,[2] Steward to King William II.

Robert died childless in about 1098, when his sole heir was his brother Urse d'Abetot (c. 1040 –1108), first feudal baron of Salwarpe in Worcestershire, Sheriff of Worcestershire in about 1069, whose daughter Emmeline married Walter de Beauchamp.

Thereafter, Elmley Castle remained a secondary possession of the Earls of Warwick until it was surrendered to the Crown in 1487.

John Leland wrote at about this time: Only earthworks now survive, which are designated as a Scheduled Monument.