Smith served as a lawman in a few small towns in Wyoming, including Bear River, as well as in Kit Carson, Colorado, prior to his move to Kansas.

The mayor of Abilene, Theodore Henry, sent for Smith in late 1869, who came highly recommended due to a reputation he had built while working alongside lawman Pat Desmond in Kit Carson, Colorado.

On one occasion, shortly after taking office, Smith singlehandedly overpowered two men known for their bad temperament, "Big Hank" Hawkins and his partner, known only as "Wyoming Frank".

Several other incidents and arrests led him to develop a solid reputation, and he became widely respected and admired by the Abilene citizens.

On November 2, 1870, Smith and a temporary deputy, believed to be named James McDonald, attempted to serve a warrant on two local farmers, Andrew McConnell and Moses Miles.

His deputy fled the scene, and as Smith lay wounded, Moses Miles hit him with the butt of a rifle, then took an axe and decapitated him.

Smith was buried in Abilene, and a huge tombstone was erected with a plaque to honor his service and ultimate sacrifice.

Trail Town by Ernest Haycox was a loose fictionalization of Smith's time as Abilene's marshal.