"That's When Your Heartaches Begin" is a 1937 song by Fred Fisher, William Raskin and Billy Hill.
It was recorded and released the same year by Shep Fields Rippling Rhythm.
On the A-side, he recorded "My Happiness", later made famous by Connie Francis in 1958.
He would later revisit the song in recording studios on at least two occasions, the first during the famous Million Dollar Quartet sessions on December 4, 1956, and the second in January 1957, when it was recorded and released as a B-side to "All Shook Up".
According to eminent author Mark Lewisohn (in "The Complete Beatles Chronicles" p. 364), the Beatles performed "That's When Your Heartaches Begin" during 1959–1961 (in Liverpool, Hamburg and elsewhere) with Paul McCartney on lead vocal.