The castle was razed by Gruffydd ap Rhys but probably rebuilt, as it is known to have been destroyed again by Owain Gwynedd in 1136.
The castle probably spent the next fifty years passing from one feudal ruler to another: from Hywel to Cadwaladr in 1144, and then ceded to Roger de Clare, 3rd Earl of Hertford in 1158, who garrisoned it.
The ruins of the medieval timber castle can be found on a hill about 1½ miles up the valley from the seaside town of Aberarth.
It occupies a strategic position at the confluence of the River Arth with the Erthyg Brook, with steep ravines on all sides except the east where there is a deep ditch backed by a bank.
The whole site is now covered by ancient oak and beech woodland which supports a varied flora.