[citation needed] In Canada, an early version of the track "Book of Reason" was released by Vertigo Records on their 1984 Vertigo Sampler 2-LP set, with a note that the track was from the forthcoming Icicle Works LP.

However, the LP never actually appeared; instead, Vertigo Canada issued a 5-track EP called Seven Horses Deep.

In 2011, Cherry Red Records issued a 3-CD expanded edition of The Small Price of a Bicycle.

The album was reviewed by Roger Holland for the music magazine Sounds where it received a perfect score of five stars out of five.

Holland wrote that The Small Price of a Bicycle was "a very fine album" and praised its "combinations of exuberant young rock rhythms and enchanting, inspiring vocals".