Even when Rupert I in 1124 inherited the position of the Bishopric of Worms' vogt in Weilburg, whose territory had included the former Königshof Nassau since 914, the conflict was not settled.

The dispute was only solved (and the title confirmed) in 1159, about five years after Rupert’s death, under his son Walram I by the intervention of the Archbishop of Trier, Hillin of Falmagne.

Walram I's son Henry II the Rich (Heinrich der Reiche) constructed the late-Romanesque main building (palas) of the castle between 1220 and 1230.

An etching by Matthäus Merian from 17th century shows an intact palas and bergfried as well as a gate building, but in the final phase of World War II, the remaining ruins were destroyed.

Its hipped roof and merlon, as well as the side towers, were again reconstructed after the etching by Merian and the six to eight metres high arcaded vault in its interiors were restored.