Its words and music were written by Hughie Cannon, an American songwriter and pianist, and published by Howley, Haviland and Dresser.

The simple 32-bar chord sequence of its chorus also underpins many other tunes played mainly by jazz bands, such as "Over the Waves", "Washington and Lee Swing", "Bourbon Street Parade", "My Little Girl", and the final themes of "Tiger Rag" and "The Beer Barrel Polka".

Cannon wrote the song in 1902 when he was working as a bar pianist at Conrad Deidrich's Saloon in Jackson, Michigan.

Willard "Bill" Bailey, also a jazz musician, was a regular customer and friend, and one night told Cannon about his marriage to Sarah (née Siegrist).

Cannon sold all rights to the song to a New York publisher, and he died from cirrhosis at age 35.