[3] Amerie had complete creative control over the project, as she wrote, recorded and engineered the songs herself, all while not knowing, then discovering that she was pregnant.

[3] Johnston acclaimed the production on After 4AM moreso than 4AM Mulholland, calling "4The Lovers" the beginning of the "stronger backbone" of the second half of songs with its "piston-like instrumental".

Johnston compared "Give It All Up" to the "strut" of the "similarly gloom-stricken" "Why R U", but said "its layers of strings and piano hint at extra drama", and also judged that there is "throwback action" on the EP, with "the rubbery synths that acted as the fulcrum for the 2008 Ne-Yo smash 'Miss Independent' and its mid-2000s radio counterparts spangl[ing] the surface of 'Midnight Rain,' while the swaying rhythms of the gentle ballad 'I Remember Us' update the strummy R&B-pop of Stargate.

"[3] Jeff Benjamin of Billboard judged that the content of the EPs "pivots from her pop-leaning past hits into a deep dive of more subdued, cavernous R&B and trance-laced productions".

Benjamin called opening track "4The Lovers" a "snappy, trap-heavy cut", and "Give It All Up" and "I Remember Us" "deliver a pang of nostalgia with flecks of jittery pop and boom bap".