When he left Dark Day, he co-founded the no-wave, art-punk band The Del-Byzanteens alongside filmmaker Jim Jarmusch, author Lucy Sante, and painter James Nares.

Every December, as part of this performance, a volunteer parade carrying boomboxes and other music players passes through Greenwich Village, presenting an ambient cacophony made of recorded bells, harps, and electronic instruments to the neighborhood.

These sayings and poems, compiled into Zippo Songs, therefore offers a lens into the social, spiritual, sexual, and emotional lives of these American Vietnam War soldiers.

[18] Other than these projects, Kline's work includes continuing commissions from Bang on a Can, American Opera Projects, the Brooklyn Youth Chorus, WNYC, the New York State Council on the Arts, Ethel and Alice Tully Hall at Lincoln Center, Jennifer Koh, Muzik3, the La Jolla Symphony Orchestra, the St. Luke's Chamber Ensemble, and for the Kotschmar Memorial Organ in Portland, Maine.

Furthermore, his works have had performances at venues across the world including, Lincoln Center, the Barbican Centre, the Amsterdam Royal Concertgebouw, the Brooklyn Academy of Music, the Royal Conservatory of Music of Toronto, The Whitney Museum, the Cleveland Museum of Art, the Kimmel Center, Trinity Church, Symphony Space, National Sawdust, The Kitchen, and the Badlands National Park.

"[24][25] Kline's Unsilent Night has been called "a magical musical parade," “a tribute to the joy of caroling" (The Village Voice), and "an ethereal sound sculpture" (The Guardian); it's been noted for the "benign sense of wonder it instilled in observers" (San Francisco Chronicle).