It was released by Maverick Records as the album's sixth and final single in the United Kingdom in November 1996, and in Australia in February 1997.

Alanis compares herself to Estella from Charles Dickens' novel Great Expectations while having a confrontation with her partner about their uncomfortable relationship.

Helen Lamont from Smash Hits gave "All I Really Want" five out of five and named it Best New Single, writing, "Aww, wow!

Alanis growls her way through from start to finish, squealing over a dancebeat and tripping over her words.

Her vocals are—uh—distinctive (the closest thing is Dolores from The Cranberries), but when you get past all the gimmicky fancy bits, what you've left with is still a brilliant, original tune.