He studied at St John's College, Cambridge,[3] and became vicar of Lutterworth and of Claybrook.

His kneeling statue by Francis Legatt Chantrey is in Lichfield Cathedral.

John Henry Newman, in his Apologia Pro Vita Sua, speaks of the veneration in which he held Ryder.

[4][5] Ryder married Sophia, daughter of Thomas March Phillips, in 1802.

Their fifth son was Admiral of the Fleet Sir Alfred Phillips Ryder.