The castle was originally built to protect the north-south route in Hollandic territory.

At the time of her death she was married to her fourth husband, Frank van Borssele.

The castle was heavily damaged around 1570 during the Eighty Years' War, and partially restored thereafter.

On 24 June 2023, the Teylingen Castle received the HKV-schildje ("shield") from the Historische Kring Voorhout (The Historical Circle of Voorhout) as a sign of appreciation for the hard work of all the volunteers and professionals in preserving the Teylingen Castle.

It consists of a massive wall with buttresses on the inside, which support arcs with a chemin de ronde on top.