[4][5][6] During his youth, Herczog's favorite sports were athletics, winning numerous first and second prizes in spriting competitions in Budapest and Vienna; and also football, joining the ranks of Magyar Úszó Egylet (MÚE), one of the first football clubs opened in Hungary, and which debuted in the 1901 season of the Hungarian League, finished second.

[8] Herczog made his international debut on 9 April 1905, in a friendly match between Hungary and Austria, which ended in a goalless draw.

[1][2][8][10] Apart from the Dutch, Herczog and the Austrian Hugo Meisl were the only foreign referees of repute present in the tournament.

In 1911, Herczog replaced Frigyes Minder as the new manager of the Hungarian national team, and in the build-up for the 1912 Olympic Games in London, he organized two friendlies against Tottenham Hotspur in Budapest, drawing 2–2 and losing 4–3; Hungary went on to win the consolation tournament after beating Austria 3–0 in the final.

[4][6][14] His managerial career came to an end when he was mobilized during the outbreak of the First World War in August 1914, where he served as a lieutenant at the front, being replaced by Minder.