A small castle was built here by Ottokar III, Margrave of Styria between 1140 and 1145.

In wartime, the archives and the family treasure was hidden here, and were guarded by the Teutonic Knights.

To escape a new roof-tax the counts of Heusenstamm around 1800 had the roof covering removed, as well as doors and window frames, beginning the decline of the castle.

In the spring of 1945 a unit of the Waffen-SS used the ruined tower above the chapel as an observation post.

In the second half of the 20th century a local organisation, Friends of the Castle Starhemberg, has sought to restore the ruins.