[2][3] Currently, the line-up consists of multi-instrumentalists Stewart (the only constant member since formation), Angela Seo, and percussionist David Kendrick.

2008's Women as Lovers was released via the main Kill Rock Stars label in 2008, and McElroy departed the group shortly afterwards.

[6] Stewart states that the group is equally influenced by Nina Simone and Krzysztof Penderecki, by The Birthday Party and Orchestral Manoeuvres in the Dark (OMD).

Continuing to focus on the subject matter of Jamie Stewart's personal life – as witnessed previously by Knife Play – A Promise acts like a concept record of internal despair.

Consisting of ten tracks, the record was oriented towards a more or less acoustic presentation, rather than relying on the booming brass and percussion which had worked to make Knife Play.

A Promise also contains a cover of Tracy Chapman's "Fast Car", a version that has been praised for its stripped sound and Stewart's distressing vocals.

[12] With the departure of Lauren Andrews in 2003 – who wished to focus on her academic studies – Stewart was joined on stage by their "long-lost" cousin, Caralee McElroy in 2004.

[13] The two would tour relentlessly throughout that year, releasing not only the group's third LP, but also split recordings with This Song Is a Mess But So Am I and Bunkbed, along with the "Fleshettes" single – which featured a rendition of the Ten in the Swear Jar track "Helsabot" by McElroy.

[16] Stewart also issued formative splits throughout 2005, working with artists such as The Paper Chase, Kill Me Tomorrow, and Devendra Banhart.

[17] Saunier, who had previously worked with Stewart on Knife Play, created for the record a greater wall of sound – a stark contrast to that of McCulloch's discordant attitude towards production.

[18] The Air Force would be supported throughout 2006 by a three piece ensemble, as Stewart and McElroy were joined by drummer/percussionist Ches Smith, who himself had previously worked with the group on Knife Play.

[12] The Air Force also contained the band's first album-based songs without vocals by Stewart – with McElroy singing "Hello From Eau Claire", as well as the instrumental piece "Saint Pedro Glue Stick".

[19] A third EP – Tu Mi Piaci ("I like you") – of songs originally recorded by acts such as Bauhaus, Nedelle, Big Star, The Pussycat Dolls, and Nina Simone was released in 2006, along with a collaboration with ambient artist Grouper, entitled Creepshow.

Their longest LP to date, Women as Lovers attempts to hone the synth-pop influences of the group's sound.

Stewart's and McElroy's duet with Michael Gira of Swans on a cover of David Bowie and Queen's "Under Pressure" is representative of this.

Thereafter, the group would begin work on its seventh LP Dear God, I Hate Myself, recording in both Oakland, California as well as Durham, North Carolina.

[29] [30] In an email sent to fans on January 28, 2013, Xiu Xiu announced that "Ches Smith, Mary Halvorson, Tim Berne, Tony Malaby, Andrea Parkins and Jamie Stewart just finished recording an album in NYC of free jazz and art song versions of all Nina Simone songs."

Since its creation, they have self-described the page as an "ephemera shoppe specializing in exclusive, obscure, out of print, experimental & overlooked zonk.

Their fourteenth album, 13" Frank Beltrame Italian Stiletto with Bison Horn Grips[36] was announced on June 25th, 2024 and released on September 27th.

The band found its first tracks to match the "rotten realness" spirit of the film, "that sometimes life turns out with a worst possible case scenario".

[6] Brandon Stosuy of Pitchfork noted a "continual poetic and romantic beauty" behind "the violence" in Stewart's lyrics.