The name Remy Zero came from an Alabama railroad worker featured in a box of 4-track tapes with 30 hours of songs, conversations, and trainyard sounds.

Cinjun Tate reported in the Evening Times, "We decided to name the band after him in the hope that we might track down his relatives or something.

[4] Before Remy Zero had released any full-length albums, Radiohead found their demo tape and invited them to be part of the US tour for The Bends.

Additionally, "Perfect Memory" played during the film The Invisible and the last episode of Smallville's first season.

Remy Zero recorded a version of Art Garfunkel's song "Bright Eyes" for the 2002 charity album For the Kids.

On October 18, 2011, Gregory Slay's final solo album, released under the moniker Horsethief Beats, titled The Sound Will Find You, featured Remy Zero bandmates Jeffrey Cain and Cedric Lemoyne and was published on the Communicating Vessels label.