The castle was built for the von Kellner family who were knights in service to the Murbach Abbey.

In 1291 the Habsburgs bought the town of Lucerne and the Unterwalden estates, including the castle and surrounding farms, from Murbach Abbey.

When the Everlasting League was created on 1 August 1291, the Kellners found themselves at odds with their neighbors and by 1308 they had been driven out.

Traditionally it was believed that the attack happened to nearby Landenberg Castle, though more recent research indicates that it may have been the Hexenturm.

The fortifications around the tower gradually fell into disrepair and in the 19th century were demolished and replaced with terraces.