He had three sons who also became theologians, among them Christian Gottlob Schirach (Křesćan Bohuchwał Šěrach) (1709–1776), who was parish priest in Holzkirch and Tiefenfurth.

His son Karl Friedrich von Schirach (1842–1917) was a major in the US Army, fought in the American Civil War on the Union side and was an honour guard at President Abraham Lincoln's funeral in 1865.

Karl Friedrich von Schirach married Elisabeth Baily Norris, a member of a prominent Philadelphia family.

Henriette von Schirach was one of the few people known to have challenged the persecution of Jews to Hitler personally, after which the couple fell into disfavour in the Nazi leadership.

One family member, Karl Gottlob Schirach (Korla Bohuchwał Šěrach) (1764–1836), published the first magazine in the Sorbian language, Měsačne pismo k rozwučenju a wokřewjenju.