When Augustin Kažotić, the Bishop of Zagreb traveled to Avignon in late 1318 to seek Pope John XXII's assistance in regard to ongoing conflicts with King Charles I, found himself exiled from the kingdom.
Hector made alliance with hospes of Kőrös (Križevci) County to attack the Čazma and Dubrava districts belonged to the diocese by ravaging its lands, looting goods and capturing prisoners.
After a series of plundering actions against the nearby villages, Hector gathered his army and besieged and captured Ludbreg Castle during a brief skirmish.
[6] Contemporary sources are contradictory, as the Gárdony brothers had their tax-exemption was confirmed by the king in 1321, while Hector fought against Ludbregi, a loyal soldier to Charles.
[6] While his brother swore allegiance to Ban Mikcs Ákos who was appointed to the position in 1325 and served as royal governor of Croatia and Slavonia, Hector remained faithful to the Babonić clan.