The label released the work of American punk rock, thrash metal and new wave music bands.

It specialized in inexpensive LPs by progressive rock and jazz artists that lacked commercial appeal.

Caroline Records rarely mentioned a connection with Virgin, and some UK and European Virgin albums that were distributed internationally (instead of being manufactured in each country) named Caroline as their American distributor.

[citation needed] The first release was Outside the Dream Syndicate by Tony Conrad and Faust in 1973.

[5][6] Its releases included the Action Swingers' single "Fear of a Fucked Up Planet", as well as Gumball's debut album Special Kiss and Monster Magnet's debut album Spine of God.