He was educated at the Whitchurch Grammar School, Shropshire, of which for a short time he acted as master.
[1] That was in 1781, and he went on to serve as curate to John William Fletcher at Madeley, and Richard Conyers at Deptford.
[1] In 1782 Bayley published a Hebrew grammar, An Entrance into the Sacred Tongue.
He wrote notes and a preface to an edition of the Homilies of the church, published at Manchester in 1811.
His other published writings were sermons and pamphlets, one being on the Swedenborgian Doctrine of the Trinity (1785).