At the time of his death in 1558, he and his wife lived in Rødkilde, an old manor house near Ulbølle to the west of Svendborg.
Like many other ladies of her day, Anne Hvide wanted a house in the town where she could spend the winter months.
[2] Built in the Renaissance style, the house is an eight-bay, two-storey half-timbered structure with a shallow cellar.
After his death in 1837, his third wife, Dorothea Svendsen, continued to run it as an inn for the next 30 years, gaining a reputation as a welcoming hostess and one of the best known people in Svendborg.
Her son Nicolaj Børgesen inherited the property but after emigrating to America sold it to Ludvigsen, a builder, until it was bought by Svendborg Municipality in 1900.