This Noble House from the 16th century was rebuilt by Alexander van Spaen (1619–1692) into the present day castle with four equal corner towers.

In 1530 Charles, Duke of Guelders made it into a castle, including the towers.

In the 18th century the family Van Spaen built the castle into its current state.

In 1076 it was donated by Henry IV, Holy Roman Emperor to the Sint-Pieter Chapter in Utrecht.

In 1849 baron Van Hardenbroek allowed Anna Pavlovna of Russia to use it temporarily.