Nine villages paid duties to the lord of the castle, including Grießbach, Großolbersdorf, Drebach and Herold.

When, in the 15th century, Greifenstein Castle was destroyed, Scharfenstein also took over the guardianship of Thum, Ehrenfriedersdorf and Geyer.

From 1921 to 1923 the damaged wings were partially rebuilt to plans by Bodo Ebhardt, based on the old design.

Hundreds of nest boxes were put up throughout the 325 hectares of woodland on the estate; bird banding was carried out and scientific reports published, with the support of the Chemnitz Ornithological Society.

[1] In 1993 the castle was taken over by the Saxon Palace Department of the Free State of Saxony (Freistaat Sachsen – Sächsische Schlösserverwaltung).