[6] Burn first published in theological controversy with Joseph Priestley, a fellow Birmingham preacher with whom he was acquainted; he received the thanks of Beilby Porteus.
[5] Priestley wrote a frank private letter to Burn in 1790, published in part later, explaining his support for Charles James Fox's legislative moves on religious tolerance, and that the Church of England was storing up trouble for itself.
[9] Burn became identified with a group of local "Church-and-King" clergy in Birmingham, including George Croft and Spencer Madan, and opponents of Priestley, if not the most extreme.
[11] A subsequent pamphlet of Burn refers to the Birmingham riots of 14 July 1791, its aftermath, and Priestley's Appeal to the Public of 1792.
Burn's later judgement (1820, in conversation with Francis William Pitt Greenwood) was that Priestley had handled him roughly; but in October 1825 he expressed public regret at a dinner for his own asperity.
[5][12] Burn died at Birmingham 20 May 1837; at the time of his death he held, with St Mary's, the rectory of Smethcott in Shropshire.