Schwarz was the son of the cantor of St. Paul Church in Zwickau, which gave him an early contact with music.

He began his musical career in 1964 as a member of the Thomanerchor,[2] the boys' choir in Leipzig founded in 1212[3] and directed by Johann Sebastian Bach, among others, as the Thomaskantor.

After completion of a church music education at the College of Church Music in Dresden, he studied at the Hochschule für Musik "Felix Mendelssohn Bartholdy" in Leipzig, voice with Gerda Schriever, organ with Wolfgang Schetelich [de] and Hannes Kästner, and conducting with Max Pommer and Hans-Joachim Rotzsch.

[6] Schwarz sang with conductors such as John Eliot Gardiner, Philippe Herreweghe, Peter Schreier, Martin Haselböck, and with ensembles including the Gewandhausorchester and the Dresdner Kreuzchor.

[9] He recorded Bach's solo cantatas for bass BWV 56, 82, and 158 with the Thomanerchor, conducted by Michael Schneider and his orchestra La Stagione.