Born in Newark, Ohio, Little moved to Kansas in 1866 with his parents, who settled in Olathe.

During the Spanish–American War, from 1898 to 1899, he was lieutenant colonel of the Twentieth Regiment, Kansas Volunteers.

Little was elected to the Sixty-fifth and to the three succeeding Congresses, from Kansas's 2nd congressional district, and served from March 4, 1917, until his death in Washington, D.C., on June 27, 1924.

He was one of the 50 representatives who on April 5, 1917 voted against declaring war on Germany Little is buried in the City Cemetery of Abilene, Kansas.

This article incorporates public domain material from the Biographical Directory of the United States Congress