He and his wife Laura moved to Wisconsin between 1842 and 1844 (sources differ), coming first to Milwaukee but settling in Concord.
In March 1850, when the new "Waukesha, Jefferson County and Madison Plank and Turnpike Road Company" which the legislature had just chartered held its organizing meeting, Kellogg was chosen to chair the meeting, and was elected to the initial board of directors.
In late November 1872, accusations were levied that Kellogg and another local Democrat had been provided unsolicited pre-approved declaration of intent ("first papers") forms[5] by the county clerk, by means of which non-citizens had been fraudulently permitted to vote in the recent election.
[6] In 1873 he was again elected to the Assembly from the 2nd Jefferson County district (now consisting the Towns of Aztalan, Farmington, Concord, Lake Mills, Milford, Oakland, and Waterloo, and the village of Waterloo) with 842 votes to 460 for Republican Stephen Faville.
[7] He was re-elected in 1874 as a Democratic-Reform candidate, with 990 votes to 697 for Republican John Spencer.