It was part of the Duchy of Westphalia and was in a position of strategic importance on the border with the County of Arnsberg.

This Herman came from the family of Binolen (Hönnetal), but later named itself after their administrative seat of Fürstenberg.

When in 1368 the County of Arnsberg was transferred to the Electors of Cologne, the border castle on the Fürstenberg hill lost its significance.

The town of Neheim, now in Cologne, took over the defensive function in this area against the counts of the Mark.

Two fortifications may be distinguished: Individual remains of the stone castle on "Richters Köpfchen" may still be seen.