The music video for the song stars Ewen Macintosh ("Keith" from the UK comedy series The Office) as an overweight man jogging through North-East London, the video cuts between him jogging and the band playing the song in a front yard.

After a while the man walks into a fast food outlet and orders a large unhealthy meal and attempts to jog and eat at the same time, only to result in him having a heart attack and dying in the middle of the road.

In the making of the "Keep It Simple" video, keyboardist Aaron described the heaven/hell part as signifying that fast food is quite literally heaven and hell for you.

[2] An indieLondon review of the album stated that "Keep It Simple" "bounces shimmering piano hooks off crunching riffs and more strings to create another giddy treat.

"[3] Ian Cohen of Pitchfork Media thought that "Keep it Simple", along with two other tracks from the album sounded "like Pavlovian biscuits of phony populism".