Raffell got his first start with the Charlie Spivak[2] orchestra in 1940 where he would meet long-time friend and professional colleague, trombonist and arranger Nelson Riddle.

[5] Raffell eventually settled in the city of Sherman Oaks in Los Angeles County near the studio music scene of Burbank and Hollywood.

As a jazz saxophonist Raffell's natural style was patterned after Lester Young and Stan Getz; his solos on records of Sammy Davis Jr. and Anita O'Day show this side of his playing.

Raffell is also heard on early R&B, pop, rock n' roll records of groups like The Platters where he achieves sounds more like Earl Bostic with growls and scoops (barwalking saxophone) which is a complete switch from Young and Getz.

Students who studied with him include David Binney[citation needed], Roger Ingram, Luis Bonilla, and Jack Cooper.