The castle was built sometime between 1147 and 1182, and served as an important fortress on the border of Styria with Hungary.

The town of Gornja Radgona grew up at the base of the hill upon which the castle is built.

Subsequently it was owned by the emperor but leased to different castellans for a long time.

In 1623 Emperor Ferdinand II sold the castle to Hans Ulrich von Eggenberg.

It remained within the Eggenberg family until 1717, when it befell Leopold, count of Herberstein (1712-1789) through marriage.