However, Władysław's reign over Legnica lasted only less than a year (1312) when he was deprived of the power by his older brother Bolesław III, because he wasn't able to pay the financial obligations imposed in the division treaty, but the official pretext was his mental instability.

Two years later, in 1314 —and after unsuccessfully attempts to pay his debt and retake Legnica— Władysław's older brothers supported him to take up a spiritual career and he was appointed Canon in Wrocław.

Another important turning point Władysław's life occurred around 1325, when he fled to Masovia, broke his vows and married with Anna, the daughter of Duke Bolesław II on 13 August of that year.

Captured, he was imprisoned for half a year in a dungeon of the Legnica castle, and was released only thanks to the intervention of his brother Henry VI the Good.

Bolesław III decided to maintain him under his custody, and Władysław spent the rest of his life throughout Silesia, under close supervision.