Margolin started playing guitar in 1964, and his first appearance on record was with Boston psychedelic band The Freeborne, and their 1967 album Peak Impressions.

In 1977 he appeared on Johnny Winter's album Nothin' But The Blues along with Muddy Waters, Pinetop Perkins, James Cotton, and others.

In 1978, he made a guest appearance on Big Joe Duskin's debut album, Cincinnati Stomp, on Arhoolie Records.

[4] In 1994, he appeared with Jerry Portnoy as guest musicians on the album, Ice Cream Man by John Brim.

The Pinetop Perkins Foundation, a non-profit organization provides financial assistance to elder blues musicians in the twilight of their careers.