He was subsequently stationed in Vienna, Athens, Bern, Constantinople and St. Petersburg, before he became Minister Resident in Luxembourg in 1900, Prussian Envoy to Mecklenburg and the Hanse city-states in 1902.

[3] After his term as Foreign Secretary, he was appointed Ambassador to Vienna, and served until his death there in 1916. on 13 December 1913, he discussed a war against France and Russia with representatives of the Triple Alliance (the German Empire, Austro-Hungary, Italy).

He and the Austro-Hungarian Chief of Staff, Franz Conrad von Hötzendorf, took the view that the situation of the Triple Alliance in Europe would deteriorate.

On the other side would be the Triple Entente, between the Russian Empire, the French Third Republic, and the United Kingdom of Great Britain and Ireland, who joined forces.

On 20 November 1888, Heinrich married Baroness Maria Josephine Karoline Alexandrine Stummer von Tavarnok (Vienna, 17 May 1868 – Mayrhofen, 29 October 1948) in Felsö Bodok.