In 1937 he returned to Germany with his family, moving in 1940 to Düsseldorf where he studied at the Robert Schumann Conservatory of Music.
In 1954, he joined the chamber music ensemble of the Berlin Philharmonic, which later changed its name to Philharmonisches Oktett.
In 1977 he founded the chamber music ensemble Philharmonische Virtuosen obtaining great international renown.
He retired from his professional activity with the Berlin Philharmonic Orchestra and from the 2001-02 academic year Rainer Zepperitz was Head Professor of the Double Bass Chair at the Escuela Superior de Música Reina Sofía (Queen Sofía College of Music) in Madrid.
Professor Zepperitz collaborated in the Spanish internet project Magister Musicae where it is possible to see his Master Classes conducted online.