The Windmill Lane sessions were highly prolific for the band, resulting in two albums worth of material, Just Supposin' and its follow-up Never Too Late, released the next year.

Initially, two singles were issued from the album, "What You're Proposing", and a double A-side, "Lies"/"Don't Drive My Car".

At the end of 1981, after the release of Never Too Late, an edited version of another track from Just Supposin', the uncharacteristic ballad "Rock 'n' Roll", also appeared as a single.

"Over the Edge" was co-written by bass player Alan Lancaster and Keith Lamb, lead singer of British bands The Case, Sleepy Talk and Mr. Toad, and founder and lead singer of Australia's successful glam rock band Hush.

[3] In their retrospective review, AllMusic mostly praised the album's set of songs, commenting that they "married the expected boogie to a new wave quirkiness that was straight out of the year's hippest fashion guides.