Gutch acquired a great reputation as a provincial journalist, and this induced him to join with Robert Alexander in starting the London Morning Journal; in this enterprise he not only lost much of the money which he had saved, but was also prosecuted for libelling George IV and Lord-chancellor John Copley, 1st Baron Lyndhurst in May 1829.
Alexander, who had been concerned in a further libel on the Duke of Wellington, was sent to Newgate Prison, and the Morning Journal was suppressed.
After his second marriage in 1823 he moved to Worcester, where he joined his wife's father as a banker, but still went to Bristol every week to superintend the publication of Farley's Journal.
Gutch possessed a large library, especially rich in the works of George Wither, which was sold by Messrs. Sotheby & Wilkinson in London in 1858 for over £1,800.
According to the writer in the Gentleman's Magazine for 1862, he also wrote some pamphlets on local subjects, and an octavo volume on the Bristol riots of 1832.