Victor was first mentioned in a document dated 1417 dealing with the inheritance of his father, who died in that year.

He inherited his father's Moravian estates jointly with his older brother Boček III of Poděbrady.

Around 1420, Victor acquired the dominion of Pardubice, which extended his eastern Bohemia possessions considerably.

For this reason Litice was besieged in 1421 by the armies of the princes and catholic nobles who sided with emperorSigismund.

After Žižka's death, Victor lead the Sirotčí for a while, but then he sided with the more moderate citizens of Prague.