Most of the Ludza Estonians probably moved into the area in the 17th century before the Great Northern War, but the settlement may have originated earlier.

Throughout the era of feudalism, when life was mostly confined to one's near environment, this ethnic group retained its Estonian identity and ethnographic features.

Ludza Estonians were originally Lutherans, but became Catholics and had close contacts with neighbouring Latgalians and Belarusians.

As long as the church ceremonies and confessions were held in Estonian, the people had little need to speak Latvian or Belarusian.

Nevertheless, the local Latgalian dialect of Latvian, Belarusian, and Russian were spoken to a certain extent in the areas where those people were their neighbours.