On 11 July 1516, Christian II of Denmark granted the brothers at Helsingør's Carmelite Priory permission to build a hospital for "poor, sick foreign seamen for rest and something, help and comfort".

[1] The building, located on present day Hestemøllestræde to the south of the priory's chapel, was 25 and contained 8–M10 beds.

It is likely that Trolle intended to expand the house further but he left Helsingør when he was appointed to Seignor of Copenhagen Castle in 1561.

In 1686, the king granted the mayor and city council permission to sell the building to a member of the donators' family to raise money for the school.

The poorhouse was later expanded with a half-timbered north and west wing, turning it into a four-winged complex with a central courtyard.