[2] Then taking orders he became vicar of Pytchley, Northamptonshire, 14 October 1637, and on 12 November 1646 was collated, but without effect, to the first prebend of Peterborough.
The following year he published another little manual entitled Όρθολατρεία: or, a brief Discourse concerning Bodily Worship: proving it to be God's due, 8vo, London, 1661.
During his boyhood, as he himself states in a letter to Joseph Henshaw, bishop of the diocese, Gunton took copies of the inscriptions on the monuments in Peterborough Cathedral, many of which were defaced by the parliamentary troops.
Ten years after his death his collections, revised and augmented with an appendix of charters and privileges and a supplement by Simon Patrick were published as The History of the Church of Peterburgh: wherein the most remarkable Things concerning that Place, from the first Foundation thereof: With other Passages of History, not unworthy publick view are represented.
White Kennett, afterwards bishop of Peterborough, wrote large additions in a copy now preserved in the cathedral library.