His younger half sister Anne Marie Louise married Charles de Rohan, famous general and friend of Louis XV.

His father eventually died in April 1730 and Charles Godefroy then became the sovereign Duke of Bouillon, a small principality in present-day Belgium.

He married his brother's widow, Maria Karolina Sobieska, the granddaughter of John III Sobieski, in 1723.

Their only daughter, Marie Louise Henriette Jeanne de La Tour d'Auvergne, was a famous adventuress, guillotined in 1793.

He started an affair with his step mother, the notably attractive Louise Henriette Françoise de Lorraine.