He was the son of the artisan and First Inspector of the Royal Munich brass foundry, Ferdinand von Miller (1813–1887), and Anna Pösl (1815–1890).
[3] Ferdinand's younger brother was the engineer and founder of the Deutsches Museum Oskar von Miller.
He was member of the Reichsrat (the House of Lords) of the Kingdom of Bavaria (the second chamber) and the Municipal council of Munich.
Miller embarked on an extensive restoration project, making the structure habitable again after 200 years of neglect.
In 1912 he was made an honorary citizen of the city of Munich,[4] and was promoted to Bavarian Freiherr (Baron) on 22 June 1912 in Berchtesgaden.