In the Middle Ages "kamer" or "room" meant house.
The earliest mention of it in town records is from the History of Haarlem by Samuel Ampzing in 1628, who claims to have copied the stichtingsbrief or letter of foundation (since lost).
In the records of the Hofje van Gratie (torn down in 1960 to make way for the new wing of the Haarlem Public Library), their stichtingsbrief from 1554 claims to be governed in the same manner by the Haarlem council as the Hofje van Bakenes.
Further records from the Haarlem archives show that the straw roofs were replaced by tiled ones in 1610, and a major restoration was conducted in 1657, which appears to be the proper date of the current buildings.
This is also the date of the keystone with the rhyme Ingang vant Gesticht/ van Dirck van Baekenes/ voor Vrouwen acht en/ twee mael ses Translation: Entrance of the foundation of Dirck van Baekenes for ladies eight and two times six Address: Wijde Appelaarsteeg 11