He attended Cane Hill College and Henry University, graduating from the later in 1883 as valedictorian and pursuing a career in law.
[5][6] He led the capture of the Rufus Buck Gang and prevented their lynching on August 11, 1895, but the men were later executed by hanging on the order of Judge Isaac Parker.
[6] In 1898, he started a law firm with Charles Bingley Stuart, James H. Gordon, and Yancey Lewis.
Rutherford led the development of water infrastructure, paved roads, and a street railway system.
[9] On December 16, 1922, Rutherford attended a Muskogee Bar Association banquet honoring Fred P. Branson and another attorney unintentionally hit him with his automobile after the event and killed him.