"His Kingly Cave" was originally recorded for an aborted album project in mid-2000 entitled Sunday Sunny Mill Valley Groove Day.

In 2002, Frank Black talked to the Free Williamsburg website about some of the songs on Devil's Workshop.

"Velvety" was written by Black as a teenager and was called "Velvety Instrumental Version" because at the time he thought it sounded like the Velvet Underground, "which, of course, it doesn't, in hindsight," he said.

"We had started to play it when we were touring on Dog in the Sand, just the instrumental version.

As a matter of fact, that was the first thing we recorded for Devil's Workshop, I believe, on the first day."