In 1613, the village was marked on a famous map of the Grand Duchy of Lithuania — Magni Ducatus Lithuaniae, et Regionum Adiacentium exacta Descriptio printed in Amsterdam and financed by the Lithuanian magnate Mikołaj Krzysztof "the Orphan" Radziwiłł.

Before World War I, the village was famous for its rodeo with bulls (the only such place in Lithuania).

During the interwar period, Neo-Gothic church with well visible modernist features was built (finished in 1932).

In 2013, coat of arms of Paberžė were created with the birch tree leaves depicted.

According to the census of 2021, the composition was the following: out of 3175 inhabitants, 1882 or 59,2% were Poles, 748 or 23,6% were Lithuanians, 363 or 11,4% were Russians, 90 or 2,8% were Belarusians, 10 Ukrainians and 84 of other ethnicity or refused to answer.