In 1549 Grand Duke Sigismund II Augustus presented the castle to his wife, Barbara Radziwiłł.

A new Renaissance red brick palace, known as Raudondvaris Castle, was built in 1615 on the high bank of the Nevėžis River by the Radziwiłłs.

The residence was known for its remarkable fine arts collection, including paintings by Leonardo da Vinci, Caravaggio, Rubens and del Sarto.

The palace belonged to the Tyszkiewicz family until the end of World War I, when it was converted into a shelter for children.

Another notable building in Raudondvaris is the basilica of St. Theresa, founded by Benedykt Tyszkiewicz (rebuilt in the 20th century), with altars painted by Michał Elwiro Andriolli, and Tyszkiewicz family tombstones.