The fortified Dóczy Castle, where the Hungarian King John Zápolya also stayed, was rebuilt by the new owner, Count Sándor Károlyi, between 1725 and 1727, and surrounded by walls after the Turkish period.

In 1730, Mátyás Bél wrote: "... Count Sándor Károlyi’s residence, built like a rectangular tower, stands...

Inside there are vaults, chambers, wine cellars, the palace in the middle is as magnificent as the entire building.

[3] At the end of the 19th century, the seat of the County moved to Szentes, so the building in Szegvár was thereafter used as an orphanage, a shelter for the elderly, and a girls' education institution from 1902, under the management of various female religious orders.

Since then, the building and its courtyard have been the scene of local events including celebrating village days, church meetings, and exhibitions.