It shows a golden sword stabbed into a green hill and silver water springing from the hole.

According to a local legend, a spring of mineral water in Kavarskas was the site of a significant event in the history of the town.

The legend recounts that, at a certain moment in time, a senior army chief was tasked with the selection of his successor.

At the end of the 15th century, the Grand Duke of Lithuania Alexander Jagiellon transferred the estate to Stanislovas Kovarskis, the treasurer of the king.

In the 16th century, Kavarskas and the surrounding area belonged to noble families of Astikai, later – Ogiński (Oginskiai), Tyszkiewicz (Tiškevičiai), and Siesickiai.

During the summer of 1941, the Jewish population was murdered in a mass execution perpetrated by German soldiers and three Lithuanian white armbanders.