He left government service in 1920, but continued to be actively involved with the Party of National Progress which merged to form the Lithuanian Nationalist Union in 1924.

Noreika was born on 19 August 1884 to a Lithuanian family of peasants in Pasruojė [lt] near Žemaičių Kalvarija and Alsėdžiai.

[2] He briefly worked as a primary school teacher in Linkuva before enrolling at the Law Faculty of Saint Petersburg University in 1909.

[1] He was a member of a committee tasked with issues of education (publishing of textbooks, establishing libraries, organizing lectures, etc.).

After the February Revolution, Noreika became secretary of the Council of the Lithuanian Nation which organized the Petrograd Seimas in June 1917.

Noreika and others from the Party of National Progress promoted the vision of full independence for Lithuanian (as opposed to autonomy within Russia).

[5] In February 1919, he became chairman of council's committee on general laws concerning internal affairs, security, justice, education.

[5] After leaving the government, Noreika started a private attorney practice and continued to be involved in public life.

[2] In 1921, together with Juozas Pajaujis-Javis [lt], he translated and published a book on modern history by Wincenty Zakrzewski.

[1] He continued to be involved with the activities of the Party of National Progress which merged to form the Lithuanian Nationalist Union in 1924.

[1] He was elected chairman of the Nationalist Union after the December 1926 coup d'état (he replaced Antanas Smetona who became the President of Lithuania).