The fortress was strengthened during the 14th and 15th centuries, when the surrounding walls were enlarged and towers added.

It was also involved in the fighting during the 1600-1611 Polish-Swedish War, in the so-called Siege of Weissenstein.

[3] In 1895-1897 restoration work was carried out on the central tower and some other parts of the castle.

However, in 1941, during World War II, retreating Soviet troops blew up the central tower and it was not repaired until after Estonia regained its independence, in 1990–1993.

[3] Today the restored central tower houses a part of Järva County museum.