Between 1674 and 1680, Füzérradvány belonged to András Hartyáni as a royal gift, and to the treasury in 1680, but it continued to be used by the widow's second husband and his son, Mihály Várady.

An amateur designer, the Count asked Miklós Ybl, his family's preferred architect, to create the new, U-shaped castle with two wings connecting to it from the north.

According to Ervin Ybl's notes, his family constantly mocked Count Ede for the design, calling him a "stubborn" because of his tall, narrow, and rather disproportionate appearance.

Between 1898 and 1913, Count László Károlyi and his wife, Countess Franciska Apponyi, purchased complete Renaissance fireplaces, door frames, and carvings primarily in Florence, from the art dealer Stefano Bardini, and in Paris, which were installed in the castle.

At that time, the upstairs rooms were divided into suites, and tennis, ski and golf courses, as well as beach and apartment houses were built in the park.