The original members included identical twin brothers Wallace "Scotty" and Walter Scott, along with Gordy Harmon, Marcus Hutson, and Nicholas Caldwell.

Walter Scott was drafted to serve in the Vietnam War during that period for eighteen months, returning to the group in 1969 after discharge.

After Harmon injured his larynx in a driving accident in 1973, he was replaced by former Friends of Distinction member Leaveil Degree.

The Philadelphia soul songwriter team Allan Felder, Norman Harris, Bunny Sigler, and Ronnie Baker provided several of the Whispers' songs, including "A Mother for My Children" and "Bingo".

Nicholas Caldwell died of congestive heart failure at his San Francisco home, on January 5, 2016, at the age of 71.