He left among his numerous unpublished writings a work entitled "One hundred and more Vocabularies of such Words as form the Stamina of Human Speech, commencing with the Hungarian and terminating with the Yoruba", 1837–40.
His only recreation was pedestrian exercise, and he at times walked fifty miles to procure a book in Hebrew or other oriental language.
[1] He died at Molesworth rectory on 30 January 1854, leaving two children by his wife, a daughter of John R. A. Worsop of Howden Hall, Yorkshire: John Oxlee (d. 1892), vicar of Over Silton 1848, rector of Cowesby 1863 (both in Yorkshire), and an unmarried daughter, Mary Anna Oxlee.
[1] In a study which Oxlee made of the Hebrew writings he was led to differ on many important points both from the Jewish and Christian interpreters.
His most important work is The Christian Doctrine of the Trinity, the Incarnation, and the Atonement considered and maintained on the Principles of Judaism, 3 vols.
In his Six Letters to the Archbishop of Canterbury, 1842–5, he stated his reasons for declining to take any part in the society for the conversion of the Jews, and his grounds for not believing in the personality of the devil.