James Kemp was born on May 20, 1764, in Keith Hall parish, Aberdeenshire, Scotland.

Brought up a Presbyterian, Kemp joined the Episcopal Church and studied theology under the direction of the Rev.

Dr. John Bowie, rector of Great Choptank parish, MD.

As bishop, Kemp invited Deacon William Levington to his diocese in 1824, and helped him establish St. James First African Episcopal Church, the third African American Episcopal church in the new country.

Kemp died of injuries received in a stage coach accident near New Castle, Delaware, while returning from the consecration of Assistant Bishop Henry Onderdonk in Philadelphia.