After Teniers, Anton Joseph von Prenner was the next to make an illustrated catalog of the paintings there in the 1720s, which included the additions of the Naples collection of Charles VI, Holy Roman Emperor.

The resulting document "The Newly Arranged Inventory of the Imperial Paintings Gallery in the Stallburg" appeared in four volumes from 1720 to 1733.

The name of the building comes from the horses of the imperial family, who were housed on the ground floor under the reign of Emperor Charles VI.

The building was heavily damaged in 1945 just before the end of the Second World War by bombs but was faithfully restored during the years 1947–1948.

Today Lipizzaners of the Spanish Riding School are housed there, the associated stud is located in Piber in Styria.