Afterwards, he served on the 27th Infantry Division command staff as an intelligence officer, also being fluent in German, French, Italian, and English.

He went on to command the 65th Infantry Regiment (1910–12) and when World War I broke out in August 1914, von Gyarmata was a colonel and chief of staff of the IV Corps.

[2][3] From July 1914 until March 1915, von Gyarmata continued to serve as the IV Corps chief of staff, which was initially deployed to the Balkan theater before being sent to the Eastern Front.

When Austria-Hungary collapsed in 1918, von Gyarmata had been serving as a section chief at the War Ministry in Vienna and briefly commanded the 40th Hungarian Infantry Division.

By the time he entered retirement in January 1919, von Gyarmata was a major general and later received the rank of lieutenant field marshal of the reserve in the Royal Hungarian Army.