There he formed an intimate friendship with Vinzenz Darnaut, the future professor of church history, and with Jakob Frint, later Bishop of St. Pölten.

Meanwhile, Milde became catechist in the Normal High School and successor of Augustin Gruber, and occupied also the chair of pedagogics at the university.

Later, as court chaplain at Schönbrunn, Milde spoke comfortingly to the Emperor Francis II, after a battle lost to Napoleon.

On 13 March the storm broke, and four days later he warned his clergy, in a circular letter, not to overstep the bounds of their calling: "Priests are not intended to advise regarding the earthly affairs of men, nor to regulate them, but should only concern themselves with interior matters pertaining to the salvation of souls."

On the other hand, a portion of the clergy clamoured that he should be declared incapable of managing the affairs of the diocese and expressed the hope of being led to victory by a stronger personality.

When finally in 1850 the imperial decisions were promulgated, which at first dealt a blow to the existing Josephist system, Milde published a pastoral for the purpose of stilling the tumult: "The uneasiness is indeed in great part the result of misunderstanding, but often also the result of malicious misrepresentation, since, through some newspapers and through speeches made by certain men inimical to the Church, the words of the august decree were distorted, and erroneous representations spread abroad."