Schwarze made his debut for St Kilda in Round 4, 2000 against Melbourne and in his early seasons was a much-maligned player.
The turning point in Schwarze's career was in Round 6, 2004 against the Brisbane Lions where he kicked the match-winning goal from 55 metres out in the last moments of the match at Telstra Dome.
In 2006 Schwarze was a steady contributor to the Saints, playing many utility roles in defence and occasionally in attack.
2006 saw him used up forward, as was evidenced in the Round 4 game against Port Adelaide where he kicked 3 goals to spark a second-half resurgence from the Saints.
He was delisted by St Kilda at the end of 2006 and, despite some interest from Port Adelaide and the Saints themselves, was not picked up by any clubs in either the National or Internal drafts.