In 1995, he joined Eintracht Frankfurt in the Bundesliga, making his debut in the competition on 12 August in the season's opener against Karlsruher SC and netting in a 2–2 home draw; he was fairly used during the course of the campaign, but again dropped down a level.
In the ensuing summer, Rauffmann signed with Arminia Bielefeld, but only lasted a few months, finishing the season on loan to Austria's LASK Linz.
In the summer of 1997, at age 30, Rauffmann moved to AC Omonia in Nicosia, which had been unsuccessful in winning a Cypriot First Division title for four years.
A penalty kick miss in the 25th round against Anorthosis Famagusta FC, however, eventually cost the team the title, lost to precisely that opponent.
In 2000–01 Rauffmann, now captain after Malekkos' departure, led Omonia to its first league title in eight years, in spite of a poor start, netting 30 goals as the national championship was conquered in the last matchday.