In an AllMusic review, Richie Unterberger writes, "'Heart of Stone' [is] a slow and soulful, dramatic ballad with the kind of vaguely discordant, droning guitars heard on many an early Rolling Stones slow number.

"Heart of Stone" was initially released in December 1964 as a single in the US where it became their second Top 20 US hit, reaching number 19.

In 1966, it was included on the collection Big Hits (High Tide and Green Grass); it later appeared on compilation albums including Hot Rocks 1964-1971 (1971), 30 Greatest Hits (1977), Singles Collection: The London Years (1989),[1] and GRRR!

This had been recorded on 21–23 July 1964 with Jimmy Page on guitar and Clem Cattini on drums, probably as a demo.

The Allman Brothers Band covered the song on their 2003 album Hittin' the Note, their first release with slide guitar player Derek Trucks.