As drummer Emma Gaze explained, the new label had "so many people and departments, and we knew, purely for that reason, that there would be more response to the new album.

"[2] Critics also commented that Too Pure was a good fit for Electrelane, as many of the other label's acts (such as Stereolab and Th' Faith Healers) shared similarities with the group.

[2] The band went to Steve Albini's Electrical Audio studio in Chicago, Illinois and recorded the album in a break-free three-week period from April to May 2003.

With Rock It to the Moon using overdubs and Pro Tools mixing, Albini was renowned for frills-free, all-analog recording, generally keeping effects to a minimum; he used these techniques on The Power Out as well.

Musically, the album is less diverse than the lyrics, with Electrelane playing within their usual Krautrock-inspired range, although the songs could be considered to be more within conventional pop structures than their predecessors.

Perhaps the most notable musical departure from Electrelane's norm is the inclusion of the Chicago a cappella ensemble for "The Valleys", to invoke a 1960s gospel hymn to the song.