His paternal grandparents were Maximilian Joseph, Count of Holnstein, married to Princess Maria Josepha of Hohenlohe-Waldenburg-Schillingsfürst (eldest daughter of Prince Charles Albert II).
In 1863, Holnstein was convicted and sentenced to imprisonment for a legally forbidden honor duel with pistols, but was pardoned by Ludwig II.
In 1866, Ludwig II appointed Holnstein Royal Bavarian master of the horse ("Oberstallmeister" in German) as successor to Baron Otto von Lerchenfeld-Aham, whom Ludwig II had dismissed at the end of 1865 because Lerchenfeld had reported a groom, who was considered the king's lover, for an alleged moral offense to the public prosecutor's office.
[9] After King Ludwig II died, Holnstein remained chief equerry for Prince Regent Luitpold until 1892.
His widow Maximiliane and his descendants lived moved out in 1907, and the castle remained unused for a long periods apart from several short-term leases.
In 1936, financial difficulties forced Maximiliane to sell the castle to the National Socialist People's Welfare shortly before her death in 1937.