His daughter Johanna of Polanen married in 1403 the German count Engelbert I of Nassau.

René of Châlon died without any children and the castle became property of his German cousin, William I of Orange, during his battle with the Spanish, it had a military function again (Dutch revolt).

In 1667 the Treaty of Breda was signed by England, France and the Republic of the Seven United Netherlands.

The Stadtholder - later King William III of England - built on the castle between 1686 and 1695, but he and his successors spent little time there.

Between 1746 and 1748 it was the site of the Breda Peace Talks between Britain and France during the War of the Austrian Succession.