Rossgarten was first mentioned as the Roß- und Rindergarten (horse and cattle pasture) in the 1300 town charter of Löbenicht.
Neighboring districts were Burgfreiheit to the southwest, Neue Sorge to the south, the Herzogsacker fields to the east, and the 17th century Königsberg fortifications to the north.
East Prussian noble families who lived in Rossgarten included the Buddenbrock, Gröben, Götzen, Kunheim, Ostau, Rauter, Schlieben, and Tettau.
In 1576 Vorder-Roßgarten received its court seal depicting a grazing white horse in a green pasture from Duke Albert Frederick.
Hinter-Roßgarten's seal, which depicted a black bull in a green meadow with a blue field, was granted in 1596 by Margrave George Frederick.
Rossgarten's main marketplace was Roßgärter Markt, located at the intersection of Vorder-Roßgarten and Königstraße near Burgfreiheit's Burgkirche.
In the Middle Ages it was known as Vorm Heiligen Kreuz, named after a nearby monastery used as a casting house for the Teutonic Knights during the era of Frederick of Saxony.
The spacious three-story building was designed by Waldemar Kuckuck and contained offices for political parties and trade unions.