Initially a short run five-song EP, The Bird Who Ate the Rabbit's Flower went out of print.

These EPs and further albums were released via Kindercore, as opposed to Bar/None Records due to the volume of material Kevin Barnes was making.

Bar/None wanted to wait to release more, so Kevin signed a deal with local Athens, Georgia label Kindercore to get all of it out.

"If I Faltered Slightly Twice" is a song about Kevin's failed relationship with the band's namesake girl from Montreal, Julie.

"The Secret Ocean" is an Elf Power cover, an Elephant 6 band that Kevin had collaborated with at the time.