He was educated at Yale under Timothy Dwight IV, graduating in 1815, then studied at Princeton Theological Seminary under Dr. Archibald Alexander and Samuel Miller.
Thereafter, he accepted a call to pastor the Second Presbyterian Church, Albany, New York, where Edward Norris Kirk had been an assistant, and where Sprague ministered for forty years.
Edward Dorr Griffin, D. D, (1838), Timothy Dwight (1845), and the Rev.Jedidiah Morse (1874), his greatest contribution to literature being his Annals of the American Pulpit, an invaluable compilation of Trinitarian Congregationalist, Presbyterian, Baptist, Methodist, Episcopalian, Unitarian Congregationalist, and other biographies.
Sprague was also a collector of historical documents and pamphlets and became the first person to gather a complete set of the autographs of the signers of the United States Declaration of Independence.
After his retirement from the Albany pulpit in 1870, he and his wife lived with his son Edward Everett Sprague, a lawyer, in Flushing, New York.