Songs of Pain was recorded between 1980 and 1981 during Daniel Johnston's Freshman, Sophomore and Junior years studying at Kent State University in East Liverpool, Ohio.

During this period, Johnston lived in his parents' basement in West Virginia, where he would make recordings to share with friends and fellow students.

In 1980, he enrolled in Kent State University in East Liverpool, Ohio, where he met Laurie Allen,[6] who would become something of a muse for Johnston.

[5] The awkward encounter which ensued inspired the song "Grievances," written in early 1980 – which in November he jokingly described as a "fluke.

"[6] David Raposa for Pitchfork also noted an influence from The Kinks' "Lola" on the track "Wicked Will",[2] and Billboard Magazine compared 'Urge' to material by Plastic Ono Band, as well as "Joy Without Pleasure" to the 'prim' song-writing of Paul McCartney.

Wolk also compared the album to 'More Songs of Pain,' which he called 'A more accomplished if less bracing take on a lot of the same themes.

[16] Willoughby Thom, writing for The Observer's retrospective on Daniel Johnston, describes Songs of Pain favorably, calling it 'Emotional and intensely beautiful,' praising its sincerity, truth, and simplistic lyrics.

[17] In July 2021, the RO2 Gallery in Dallas, Texas, hosted an exhibition of Johnston's art named after the album, 'Story of an Artist & Songs of Pain'.