The CD single included "Gonna Try It Anyway," which was available on the Japanese edition of So Natural only, and remixes of "Little Bit of Heaven" created by David Morales, Pete Heller, Terry Farley, Roach Motel, Paul Waller and Seamus Haji.

[12] In a 2018 retrospective review, Quentin Harrison from Albumism described "Little Bit of Heaven" as "breezy", with "its flavor deepened with some chirpy disco widgetry.

[14] In his weekly UK chart commentary, James Masterton noted that here, Stansfield "eases back onto the dancefloor for her third hit of the year".

[15] Pan-European magazine Music & Media wrote, "What would the entire heaven be like, is the question that arises on hearing this danceable soul song.

"[16] Alan Jones from Music Week gave it three out of five, commenting, "In isolation, this classily delivered song is pleasant enough, but it would be nice to hear Stansfield ringing the changes.

"[17] James Hamilton from the Record Mirror Dance Update called it a "pleasantly melodic light-weight mellow lurching loper".

[18] In a 2015 retrospective review, Pop Rescue remarked that "there's some nice vocal harmonies in the chorus, with some funky brass sections and disco 'pops'.