He grew up on a farm in Bean Blossom, Indiana,[N 2] and served in the Union Army during the American Civil War, where he played the bugle.

He married Sarah Ann Casey and raised a family, earning his living as a farmer, first in Indiana and then in Missouri near Maysville.

It was in Sedalia that Stark heard Scott Joplin play the "Maple Leaf Rag", and on August 10, 1899, he bought the number for $50 plus royalties of one cent per copy.

After an initial printing of 5,000 copies, a million were eventually sold, which enabled Stark to open an office in St. Louis, Missouri (and, in 1905, New York City) and Joplin to engage in composing for a living.

Over the next two decades, Stark published and promoted the "classic" style rag pioneered by Joplin and other composers, including Joseph Lamb, James Scott, Arthur Marshall, Paul Pratt, Artie Matthews, Robert Hampton, J. Russel Robinson, and his son Etilmon Justus Stark.