Established in 1999, the museum is located in the building of the former Varniai Priest Seminary which was relocated to Kaunas after the failed Uprising of 1863.

[3] In 1770, a new brick building in the late Baroque style was built by Bishop Jan Dominik Łopaciński [pl].

When he became the bishop, Valančius organized a teetotalism movement, spent considerable effort on educating children and adults, and organised the smuggling and distribution of the banned Lithuanian books.

[2] The new regime of President Antanas Smetona used the camp to house political prisoners, mainly members of the outlawed Communist Party of Lithuania.

Its collections include archaeological artifacts found during excavations in Varniai, physharmonica and church organ (built in 1909), various liturgical and religious objects (sculptures, crosses, banners, icons, paintings, vestments), 5,557 religious postcards and medals donated by Algimantas Urbonas, various records and documents from local parishes, etc.

[12] The items include sets of Meissen and Rosenthal porcelain dishes and two early 19th-century pistols.