Walking on a Thin Line is the third studio album by Guano Apes.

Recording Walking on a Thin Line went slow and was delayed multiple times.

In the 2005 documentary Planet of the Apes, Dennis Poschwatta said that the band "made the mistake of going [into the studio] with unfinished songs.

At the time of the release of "You Can't Stop Me" it was still unclear what the album title would be.

Despite all that, Sandra Nasić called the album her favorite, saying she considered it "the most mature thing [Guano Apes had] done" and that they'd "essentially achieved what [she] was aiming for".