It incorporates elements of African music, continuing an approach used in an earlier Talking Heads song, "I Zimbra".

[4] Janovitz claims that the "thick menage of polyrhythmic percussion, staccato guitars, popping bass, and Devo-like electronic blips and bleeps" make this protagonist even more threatening than the one in an earlier Talking Heads song, "Psycho Killer".

[2] Gittens likewise concurs that the contrast with "warmth and gravitas" of the "humane backing" deepens the impression of the song's I-persona as being unstable.

[4] Janovitz notes Byrne's vocal performance in speaking and shouting his bitter lines and threats through the complex music.

[6] A medley of "Born Under Punches (The Heat Goes On)" with two other songs from Remain in Light, "Crosseyed and Painless" and "Once in a Lifetime", reached No.