The words and music were written by Hughie Cannon, an American songwriter and pianist, and it was published by Howley, Haviland and Dresser.

The simple 32-bar chord sequence of its chorus also underpins many other tunes played mainly by jazz bands, such as "Over the Waves", "Washington and Lee Swing", "Bourbon Street Parade", "My Little Girl", and the final themes of "Tiger Rag" and "The Beer Barrel Polka".

Cannon wrote the song in 1902 when he was working as a bar pianist at Conrad Deidrich's Saloon in Jackson, Michigan.

Willard "Bill" Bailey, also a jazz musician, was a regular customer and friend, and one night told Cannon about his marriage to Sarah (née Siegrist).

Willard and Sarah Bailey later divorced; he moved to Los Angeles with their daughter Frances, and died in 1954.