Toward the Within was recorded in one take in November 1993 at the Mayfair Theatre in Santa Monica, California and was released by 4AD as an album and a video (VHS and LaserDisc) a year later.

It was the last major event to take place in the Mayfair Theatre before it was severely damaged in the Northridge earthquake in January 1994 and had to be closed indefinitely.

It contains interviews with Gerrard and Perry, as well as a music video for "Yulunga (Spirit Dance)", composed of clips from Baraka.

In addition to the original content, the DVD release contained a few extras: a discography; music videos for "Frontier", "The Protagonist" and "The Carnival Is Over"; and a chapter from Baraka titled "Calcutta Foragers/Homeless", which is set to Dead Can Dance's "The Host of Seraphim".

[11] Sinéad O'Connor performed the song in a traditional style over a hip hop drum beat on her 1990 album I Do Not Want What I Haven't Got.