James was the third son of the Reverend John Coleridge, the well-respected vicar of St Mary's Church, Ottery St Mary and was headmaster of the King's School, a free grammar school established by King Henry VIII in the town.
He had previously been master of Hugh Squier's School in South Molton, Devon, and lecturer of nearby Molland.
[1] James obtained his captaincy during the period of the French Revolutionary Wars and was later promoted to Colonel.
He purchased the Coleridge family home, the Chanter's House, in Ottery St. Mary, Devon in 1796.
[2] On 27 February 1788 he married Frances Duke Taylor at St Mary Arches Church, Exeter.