He began writing poetry and fiction in his early teens, and first published his poems in the mimeo magazine Wild Dog, an issue guest-edited by Joanne Kyger, in 1965.
After his breakup with Waldman, Warsh lived in Bolinas, California from October 1969 to August 1970, where his neighbors included Joanne Kyger, Tom Clark, Bill Berkson, Bobbie Louise Hawkins and Robert Creeley.
The “series lasted about six months and was many ways a temporary West Coast version of the Poetry Project; Robert Creeley and Ted Berrigan shared a bill, Joe Brainard and Joanne Kyger read together, Philip Whalen read with Allen Ginsberg, and so on.”[4] From 1973 to 1974 he lived in Cambridge, Massachusetts and co-edited The Boston Eagle with William Corbett and Lee Harwood, before returning to New York in 1974.
Warsh wrote: We were living in relative isolation in Lenox, Massachusetts, and editing a magazine put us in touch with poets and friends we had left behind in New York.
We managed to buy an inexpensive mimeo machine in Pittsfield and we produced the magazine in the living room of our large apartment on the main street of Lenox.
“[They] seem a natural if not inevitable extension of his writing, and portray a visual dimension that is sumptuous, alluring and mysterious.”[9] Warsh's unpublished novel, Delusions of Being Observed, was serialized in The Brooklyn Rail, from October 2016 to June 2018.