After passing through several owners, around the end of the 15th century it was acquired by the Feer family.

Around 1510, Petermann Feer rebuilt it into a late-Gothic castle.

In 1964 a fire partially destroyed the castle and it was acquired by the canton.

Renovations in 1981–83 and 1992–96 repaired the damage and restored the moat.

In 1996 it became a museum, housing the Josef Zihlmann collection of local religious art.