Taking Liberties is a compilation album by English singer-songwriter Elvis Costello, consisting of tracks not previously released on his albums as released in the United States.

It is largely made up of B-sides, but features three previously unreleased recordings.

The differences are that on the latter, the tracks "Night Rally", "Sunday's Best" and "(I Don't Want to Go to) Chelsea" are replaced by "Watching the Detectives", "Radio, Radio" and "(What's So Funny 'Bout) Peace, Love, and Understanding".

[1] The sleeve note by Gregg Geller is very nearly a direct lift from the 1958 album A Gene Vincent Record Date, with Costello's name substituted for Vincent's, and song titles being substituted as appropriate.

The legend on the Side One label reads "COSTELLO" instead of "COLUMBIA", in a similar fashion to This Year's Model.