The castle became the administrative and economic centre of the family's lands, a part of which Vok gave to the newly established Cistercian monastery in Vyšší Brod.
After 1330 Jindřich of Rožmberk built the Dolní hrad (Lower Castle), which was defended by ramparts placed above the moat, which was cut through the neck of the rock.
The image of Perchta on the Rožmberk castle contains a mysterious inscription in the Enochian script, that in his personal journals already mentioned Rudolphian occultists John Dee and Edward Kelley.
The Buquoys, whose main residence was in Nové Hrady, repaired and altered their family seat (1840–57), remodelling the building in the style of Romantic Neo-Gothic, and keeping it until 1945 when it was nationalised after the end of World War II.
The interiors, mostly renovated in the Neo-Gothic style, are furnished with valuable pieces of furniture, some of which feature custom wood carvings commissioned for the museum.
The castle picture gallery contains several valuable Czech and European paintings from artists of the Late Renaissance and Baroque eras, such as Bartholomeus Spranger, Karel Škréta, Jan Kupecký, and Norbert Grund.
The armoury contains a unique collection of stabbing and cutting weapons, firearms, war relics, and heraldic emblems.
Now the elephant is back home in Switzerland and the copy stands in its place to delight visitors, who gently touch it.