Musically, the song is made up of a suite of various segments, ranging from a piano ballad at the beginning through to guitar arpeggios at the end.

Some musical segments of "You Never Give Me Your Money" were reused for the "Golden Slumbers" / "Carry That Weight" portion of the medley, including the opening verses and later guitar arpeggios.

[7][8] Beatles author Ian MacDonald speculates that the guitar arpeggios at the end of the track were influenced by "I Want You (She's So Heavy)" and the middle section of "Here Comes the Sun", and that the overall structure was inspired by Lennon's "Happiness Is a Warm Gun" from the previous year's album The Beatles, which also joined unrelated song fragments together.

The cross-fade from "You Never Give Me Your Money" into the next track, "Sun King", proved to be problematic, and the group made several attempts before deciding to merge the songs via an organ note.

[14] The final recording session occurred on 5 August, when McCartney made a number of tape loops at EMI Studios, including bells, birds, bubbles and chirping crickets.

[17] According to Ian MacDonald:[2] American guitarist George Benson covered the song in a medley with "Golden Slumbers" in his 1970 album The Other Side of Abbey Road.

[18] Comedy rock duo Tenacious D covered "You Never Give Me Your Money" in medley with "The End" as a single released on 2 July 2021.