After education at the Leathersellers' Company's school in Lewisham, he entered Independent College, Homerton as a scholar in 1798.
[1] In 1812 he succeeded Joseph Fox as joint secretary of the London Society for Promoting Christianity Amongst the Jews, retiring with his Anglican colleague Thomas Fry in 1814.
[2][3] Collyer and Fry's translations into Hebrew of the Gospels of Matthew and Mark, carried out with the help of Judah D'Allemand, were published in 1813 and 1815 respectively.
[4][5] From 1820 to 1824 Collyer edited, with James Baldwin Brown the elder and Thomas Raffles, The Investigator, a quarterly.
[7] In 1823 Collyer rode out a scandal around his examination of young men, in the Addington Square baths, that was brought up in The Lancet.