Baumann started his coaching career at Rot-Weiß Erfurt when he was hired on 19 February 2008.

[4] His first match as head coach was a 5–0 win against the reserve team of VfL Wolfsburg on 23 February 2008.

[6] Baumann was sacked on 28 April 2009,[7] three days after Rot-Weiß Erfurt lost to Kickers Emden 1–0.

[12] Then on 22 February 2012, Erzgebirge Aue hired Baumann as head coach after Rico Schmitt was sacked the previous day.

[13] His first match as head coach of Erzgebirge Aue was a 2–0 loss to Energie Cottbus.