In 1868, he was admitted to the teachers' seminary in Valka under the leadership of Latvian composer Jānis Cimze.

After graduating in 1871, Krogzemis begin his teaching career in Jaunpiebalga, but was soon forced to leave the school due to conflicts with the local pastor.

However, due to these activities and his anticlerical poetry, he soon found himself in conflict with the local pastor and was forced to leave.

[2][3] Krogzemis moved to Vecpiebalga where he lived and worked with Atis Kronvalds, but their collaboration proved unsuccessful.

In St. Petersburg, he became close friends with Latvian composer Baumaņu Kārlis and contributed to the satirical magazine Dunduri.