He was the oldest son of Count Albert III and his wife Ida of Saxony, the heiress of Laroche.
He first married in 1087 Sibylle, a daughter of Count Roger of Château-Porcien and his wife Ermengarde.
Together, they had two daughters: Sibylle and Godfrey divorced in 1105 because of her pregnancy by her lover Enguerrand I, Lord of Coucy.
In 1109, Godfrey married Ermesinde (d. 24 June 1143), the daughter of Count Conrad I of Luxembourg and his wife Clementia.
Together, they had the following children: Emperor Frederick Barbarossa decided that Ermesinde was the heir to the County of Luxembourg.