The extended play consists of three string quartet-driven chamber renditions of songs from How to Dress Well's debut album Love Remains (2010), as well as another track, "Suicide Dream 3".

[2] Despite the orchestral instruments and a clean sound, some critics noted Just Once to still have a "crude" and "homemade" feel as Love Remains did, as well as maintaining the same harmony arrangement style as the full-length album.

[2][3] One critic from Beats per Minute described the tracks as "delicately arranged" for them to be "aggressively homemade", an example of this fact being a certain point in the EP where Krell pressing a button to stop recording can be heard.

[2] Halfway into the length of the track, the publication analyzed that "everything sort of drops away to let singular notes peel off into the expanse while Krell's yearning half-lidded whispers waver around the space.

"[9] The review was still positive; Rytlewski wrote that the tracks "reveal how harmonically rich those Love Remains songs were under all their static" and that "it's a marvel, in retrospect, how Krell condensed such oversized melodies into such scruffy recordings.

[5] Pitchfork described it as "a potential argument that How to Dress Well is best in short four- or five-song bursts, the way the first few EPs arrived-- you get the feeling Krell's songs evoke for 18 or 20 minutes, and then you move on.

"[3] All tracks written by Tom Krell, arranged by Minna Choi, recorded and mixed by Nic Atamaniuk at Different Fur Studios and mastered by Pete Swanson.