Two previously unreleased studio tracks are included, Bob Dylan's "To Make You Feel My Love" and Goffin/King's "Hey Girl", while the third new track, "Light as the Breeze", was originally recorded for a Leonard Cohen tribute album known as Tower of Song: The Songs of Leonard Cohen in 1995.

Joel's cover of "To Make You Feel My Love" came out two months before Bob Dylan released his own version for his 1997 album Time Out of Mind.

To help promote the album, Joel filmed music videos for both "To Make You Feel My Love" and "Hey Girl", featuring himself performing with his band.

In addition, Joel performed "To Make You Feel My Love" as musical guest on The Late Show with David Letterman on August 18, 1997, almost exactly four years after Joel served as the first musical guest on Letterman's premiere show for CBS.

Commercially, the collection paled in comparison to the first two greatest hits volumes, only achieving platinum status.