He had a volume of sermons published in 1722, and also a collection entitled Hymns and Spiritual Songs, which included "Come, Holy Spirit, Heavenly Dove" and "And Now, My Soul, Another Year".
He developed the belief, that due to his act of murder, he had become eternally damned, and that his soul had been removed from his body.
[3] Browne abandoned the ministry in late 1723 due to the sudden depression brought on by the highway robbery, and returned to Shepton Mallet.
There he continued to write, including books for children, translations of Latin and Greek poetry, and an abstract of the Bible.
He also published three theological works: A Fit Rebuke to a Ludicrous Infidel, A Defence of the Religion of Nature and the Christian Revelation, and A Sober and Charitable Disquisition Concerning The Importance of the Doctrine of the Trinity.