He coached Mainz 05's second team, then Lokomotive Leipzig, before going through the ranks at Red Bull Salzburg.

When Hannover reached promotion to the Bundesliga in 2002, Rose went to Jürgen Klopp's Mainz 05 on loan.

[citation needed] Rose started his career as assistant coach and player of Mainz's second team in the 2010–11 season.

[citation needed] Rose joined Red Bull Salzburg's U16 team in the 2013–14 season.

The team won the Austrian U18 championship in his first season and the UEFA Youth League in April 2017 beating Benfica 2–1 in the final.

[3] For the 2017–18 season, Rose succeeded Óscar García as head coach of RB Salzburg.

[7] On 15 February 2021, Mönchengladbach announced that Rose would leave at the end of the season to join Borussia Dortmund.

[12] On 3 June 2023, he won his first title at the club, after a 2–0 victory over Eintracht Frankfurt in the DFB-Pokal final.