Before joining the New York Dolls in 1971, Sylvain was a member of the band Actress, which also featured Arthur Kane, Johnny Thunders and former fashion partner, Billy Murcia.

He landed a solo recording contract with RCA, and released one album with Lee Crystal (drums; later of Joan Jett's Blackhearts) and Johnny Ráo (guitar).

His bandmates on this record were: Brian Keats, drums, John Carlucci, bass, and Olivier LeBaron' on lead guitar, with guest appearances by Frank Infante of Blondie and Derwood Andrews of Generation X.

In the late 90s he teamed up with the LA punk band The Streetwalkin' Cheetahs for some touring and they recorded a live radio broadcast on KXLU that remains unreleased.

[15] On March 18, 2010, at the South by Southwest music festival in Austin, Texas, Sylvain and Cheetah Chrome of The Dead Boys and Rocket from the Tombs debuted their new band, The Batusis.

[17] In 2018, Sylvain joined forces with Steve Conte, Sami Yaffa, and Robert Eriksson for two one-off dates in Tokyo as "The Dolls".