A large old-regulation Carmelite monastery adjoining the church was built by adapting existing buildings.

In the 16th–18th centuries the Carmelites actively participated in public life, held religious feasts and processions.

In 1908 vicar Petras Kraujalis started to hold services in Lithuanian, which was opposed by Polish clergy.

During Soviet occupation, the church housed a museum of folk art after the reconstruction between 1967 and 1975 by architect Aldona Švabauskienė.

[2] In 1877 the Church of St. Joseph the Betrothed was demolished by the tsar's order, to be replaced by a market (presently it is a square).