Jones' recording session for "Why Baby Why" took place at Gold Star Studios in Houston, Texas and featured the house lineup of Glenn Barber on lead guitar, Herb Remington on pedal steel guitar, Tony Sepolio on fiddle, and Doc Lewis on piano.

[7] In the liner notes to the retrospective Cup Of Loneliness: The Classic Mercury Years, country music historian Colin Escott observes that part of the song's appeal "lay in the way a Cajun dance number was trying to break free of a honky tonk song."

Jones recorded the backing vocal himself, with help from innovative techniques from engineer Bill Quinn, after a planned appearance by more established singer Sonny Burns did not materialize due to the latter's drinking.

The single's early airplay occurred in Jones' home state of Texas, with Houston's country music station KIKK ranking it number one locally.

[9] Their charts were sent to stations around the country, which began to pick it up as well, partially overcoming Starday's regionally limited distribution.