From 1896 he worked for a time as an architect in Trondheim, in a rigorous and constructive Art Nouveau style, but also painted landscapes, portraits and several altarpieces.
Kielland is best known as the creator of the Rose Window (Rosevinduet i Nidarosdomen) in the Nidaros Cathedral in Trondheim.
In 1908 he won the competition for the stained glass windows for the reconstruction of the Nidaros Cathedral's southern gable.
The paintings are iconographic imagery which were produced in collaboration with Oluf Kolsrud (1885–1945), professor of church history.
The Rose Window was presented as a gift from the women of Norway for the anniversary of the death of St. Olav in 1930 and is regarded as Kielland's masterpiece.