The hymn was sung to the melody Sarum, by the Victorian composer Joseph Barnby, until the publication of the English Hymnal in 1906.

This hymnal used a new setting by Ralph Vaughan Williams which he called Sine Nomine (literally, "without name") in reference to its use on the Feast of All Saints, 1 November (or the first Sunday in November, All Saints Sunday among some Lutheran church bodies or those congregations whose membership makes weekday services infeasible).

Since the 1990s, some Presbyterian churches and groups affiliated with Reformed University Fellowship in the United States use a tune composed by Christopher Miner.

On a request by German composer Heinz Werner Zimmermann, Anna Martina Gottschick wrote a hymn "Herr, mach uns stark" (Lord make us strong [in courage to confess you]) to the "Sine nomine" tune in 1972, because the composer wanted to make it available for German church singing.

The version in German Protestant and Catholic hymnals closes with a stanza which Jürgen Henkys translated from "For All the Saints".