Frey and JD Souther, who had earlier been the duo Longbranch Pennywhistle, sang background vocals on three tracks.

"[2] "Baltimore" was covered by Nina Simone, Nils Lofgren, the Tamlins, David Gray, Billy Mackenzie, Lianne La Havas, Jazmine Sullivan, and Mink Stole.

The album's cover artwork is a photographic portrait of Randy Newman by Bob Seidemann.

It shows Newman standing on the West 7th Street overpass above the I-110 freeway in the Financial District of Los Angeles.

The New York Times opined that Little Criminals "is the first Newman album with a full complement of musical witticisms to match the verbal ones.

"[7] Record World said that the single "Baltimore" "is as serious as 'Short People' was funny, and its haunting melody and dramatic lyric linger well.