After Floris V attempted to escape, Gerard personally killed the count on the 27th of June 1296 by stabbing him 20 times.

1370–1386) the castle was rebuilt on the same spot based on the same plan, by Albert I, Duke of Bavaria, who at that time was also the Count of Holland and Zeeland.

Hooft (1581-1647), an author, poet and historian took over sheriff and bailiff duties for the area (Het Gooiland).

For 39 years he spent his summers in the castle and invited friends, scholars, poets and painters such as Vondel, Huygens, Bredero and Maria Tesselschade Visscher, over for visits.

[3] He also extended the garden and the plum orchard, while at the same time an outer earthworks defense system was put into place.