He was the eldest of seven children born to the miller, Johann Philipp Wille, and his wife, Anna Elisabeth née Zimmermann.
Initially, he studied mathematics in Giessen, with the intent of attending a university, but his interest in art prevailed and he began taking lessons from a local portrait painter.
This proved to be unsuccessful, so he learned engraving instead and worked for a gunsmith, who taught him how to decorate hunting rifles.
Through these clients, and his art dealing, he amassed a considerable fortune, which enabled him to turn his attention from portraits to whatever caught his fancy.
Efforts to support himself by selling his earlier works failed, as all of his previous clients and collectors were struggling to get by.