The song was recorded in April 1967 at American Sound Studio in Memphis in the sessions for the Sweet Inspirations' self-titled debut album, produced by Tommy Cogbill and Tom Dowd.

Although Tom Dowd called for a lunch break (Dan Penn quote:) "Spooner had [the opening rolling guitar] lick down so good the musicians wouldn't go eat...They knew by what was happening we could [immediately] cut [the track]," which was completed in a single take.

Upon returning to the studio from their lunch break, Dowd and his coterie were played the completed track of "Sweet Inspiration" - (Oldham quote:) "We basically gave 'em a gift.

In 1989 Dutch female quartet Sisters would have reach #58 on the Nederlands Single Top 100 with their remake of "Sweet Inspiration" taken from the group's album Near Me.

Vonda Shepard recorded "Sweet Inspiration" for her 9 November 1999 album release Heart and Soul: New Songs from Ally McBeal.