After graduation, Kleihues spent one year at the École nationale supérieure des Beaux-Arts in Paris.
As professor at the TU Dortmund University from 1973[1] and director of the International Building Exhibition Berlin (IBA) between 1979 and 1987, Kleihues propagated the concept of urban "critical reconstruction".
From 1986 to 1991 he held the Irwin S. Chanin Distinguished International Professorship at The Cooper Union's School of Architecture.
In 1989 his work was presented in Joseph Paul Kleihues: The Museum Projects, an exhibition and an accompanying catalog (Rizzoli, 1989) at The Cooper Union.
[1] He also chaired the jury that awarded Daniel Libeskind the commission to build the Jewish Museum Berlin.