On the soundtrack, there is some dialogue from the movie at the end of the track; meanwhile, the single version is a radio edit, with the bridge omitted.

Joey Waronker was brought in on drums; Scott McCaughey and Ken Stringfellow were each invited to take part; Pat McCarthy returned to the producer's chair."

In the unedited version, at 4:09 and at 4:26, the listener can hear Michael Stipe singing the following lines in the background: "Here's a little agit for the never-believer, here's a little ghost for the offering".

Carrey revealed in the 2017 documentary Jim & Andy: The Great Beyond that he had been invited to appear in the video in person, but refused, as he wished to psychologically distance himself from the Kaufman character; he stated that he now regretted the decision.

In June 2003, Michael Stipe sang an a cappella excerpt from the song for a BBC Radio 2 advertisement.