The fourth child in a Noble family, he had two sisters and three brothers, among others writer Cesar von Düben.

His father was a prominent courtier and close friend of Gustav, Prince of Vasa, and his grandfather Henrik Jakob von Düben was a hofmarschall.

[2] Von Düben was educated at Military Academy Karlberg, where he graduated as a cadet.

In 1855 he shouldered his father-in-law Carl Reinhold Tersmeden as the estate owner of Kägleholm.

[8] In 1862 he made donations to Finnish people in need as the Great Famine of the 1860s had struck Finland.