Under the ownership of Matthias Csák of Trenčín, a single-storey Gothic palace was built on the site around 1315.

The site underwent another large-scale transformation in the mid 15th century when another palace was added, while most of the pre-Gothic fortification was taken apart.

[3] The late Gothic structures from the 15th century were replaced in the Renaissance period by an anti-Turkish star fortification, connected by casemates with an external and internal moat.

[3] After 1736, when the town and the castle became the property of the Franz I, Holy Roman Emperor (husband of Maria Theresa), the Renaissance fortress was gradually reconstructed into a three-winged Baroque mansion.

[2] Testifying to the royals' interest in the site, the reconstruction was carried out under the supervision of some of the most important Austrian architects and artists at the time: Franz Anton Hillebrandt, Jean Nicolas Jadot and Joseph Chamant.

A broad new central street connecting the town and the castle was also added during the renovation.