The band released two singles during their existence, including the song "Leave Me Alone", which is now considered a classic of the musical genre of garage rock.

In addition, the group's sound was particularly unique for combining elements of folk rock and proto-punk, making the Knaves stand out among their contemporaries.

[1] The band sustained a sizable local following in Chicago based on a repertoire of cover versions by musical artists such as the Rolling Stones, the Yardbirds, and the Kinks.

"Leave Me Alone" became a top five hit in Chicago, and, while it is featured on more compilation albums than its flip-side, "The Girl I Threw Away" was particularly unique for its combination of Byrds-inspired folk rock and protopunk.

[4] The commercial failure of the single did not impact the group regionally as the expanded their touring throughout Illinois, and they appeared on local television programming.