Herman was born in Freiburg im Breisgau as the eldest son of Berthold I of Zähringen.
He married Judit of Backnang-Sulichgau, Countess of Eberstein-Calw, who was the founder of Hirsau Abbey.
Subsequently, the monastery was the resting place for five generations of the Margraves of Baden.
While he never ruled in Verona, a dependency of Carinthia, the margravial title was to remain with his descendants.
In 1073, he separated from his wife, took monastic vows, and became a lay brother in Cluny Abbey, where he died.