[4] The recording took place in a large studio in the Opera Bastille, accompanied by four violinists from its orchestra, and Jay rented for the occasion the first synthesizer used by the Beatles.

In 2002, Elia Habib describes "Caroline" as "an ode to the city, a moving work transfiguring the everyday environment in inventive, modern and expressive love terminology", uses puns like those of Serge Gainsbourg and displays a "linguistic erudition reminiscent of Raymond Devos".

[5] In 2021, French newspaper Liberation speaks of a "masterfully chiseled text", and of music that "twists with delight and languor around a subtly vaporous electronic construction that quite closely resembles it to nascent trip hop".

[2] In 1998, Solaar recorded a live version of "Caroline", which was included on his album Le Tour De La Question and released as a charting single in France and Belgium (Wallonia).

[10] In 2020, Black M covered the song live accompanied by 300 choristers for a French TV show broadcast on France 3, and Voltage called it "a breathtaking performance".