My Heart Will Always Be the B-Side to My Tongue is the third EP by American rock band Fall Out Boy, released by Fueled by Ramen on May 18, 2004.

The CD is packaged with a bonus DVD, featuring the background of the band, music videos for "Dead on Arrival" and "Grand Theft Autumn/Where Is Your Boy", an acoustic performance and more extras.

The band's subsequent third album From Under the Cork Tree contains a version of "Nobody Puts Baby in the Corner" with electric instrumentation, and a similarly arranged demo of "My Heart is the Worst Kind of Weapon" is a bonus track on From Under the Cork Tree (Limited "Black Clouds and Underdogs" Edition).

All tracks written by Fall Out Boy, except for "Love Will Tear Us Apart" written by Ian Curtis, Bernard Sumner, Peter Hook, Stephen Morris A Clandestine Industry Presents: Release The Bats DVD was released in 2005, containing footage mostly shot during the making of the My Heart Will Always Be the B-Side to My Tongue DVD, but "deemed unfit".

It includes footage encompassing the early years, backstage antics, reckless stunts, and live footage of Armor for Sleep and Gym Class Heroes; it also contains clips from Fall Out Boy in Japan, the band's summer tour and the near-riot during the band's Detroit performance at Warped Tour in 2004.