Bullock was born in Bethlehem, New York and moved to Augusta, Georgia, in 1857 for his job with the telegraph company Adams Express.

After various allegations of scandal and ridicule,[6] in 1871 he was obliged by the Ku Klux Klan to resign the governorship, and felt it prudent to leave the state.

[1] He was succeeded by Republican State Senate president Benjamin Conley, who served as Governor for the two remaining months of the term to which Bullock had been elected.

Conley was succeeded by James M. Smith, a Democrat, and no Republican would serve as governor of Georgia again until Sonny Perdue in 2003.

He later became president of the Atlanta Chamber of Commerce, and in 1895 served as master of ceremonies for the Cotton States and International Exposition.