He was born at Tulse Hill in July 1775 and started a legal career, but left it early for scholarly and literary pursuits.
A bust of John Horne Tooke at University College, London, by Francis Leggatt Chantrey, was bequeathed by him.
In 1834 he issued the prospectus of a New English Dictionary, and the work itself was published by William Pickering in parts between January 1835 and the spring of 1837.
It was published in volumes, with additional front matter and some omitted words including "retrospect" appended, in April 1837.
He contributed papers to the Gentleman's Magazine, and wrote essays on 'English Grammar and English Grammarians,' and on 'Fancy and Imagination.'
He married the artist Elizabeth Nasmyth, widow of Daniel Terry the actor, whose son was at his school.