Passarge studied art history and received his doctorate in 1923 at the University of Leipzig under Wilhelm Pinder with a thesis on the German Vesper image in the Middle Ages.
He initially worked as an art historian at the Museum in Erfurt from 1922 to 1925, then until 1927 as a lecturer at the State Art Academy in Kassel and until 1936 as assistant director at the Thaulow Museum and as a lecturer at the craft school in Kiel.
During his time at the Kunsthalle Mannheim there, he was mainly concerned with the second wave of Nazi confiscations in 1937 and their influence on the selection of the art on display.
[2][3] He shifted the focus of the Mannheim Kunsthalle to the politically less sensitive arts and crafts.
After the Second World War, it was up to him to rebuild the Kunsthalle, which had been greatly reduced by the effects of National Socialism and World War II, with a special focus on German and modern art as well as the collections of the 19th and 20th centuries.