Although the Voree area was inhabited by Native Americans prior to the arrival of the first Europeans, the most notable part of its history begins in 1844, after the death of Joseph Smith Jr., founder of the Latter Day Saint movement.

James J. Strang, who had declared himself Smith's successor, established Voree, then within the Wisconsin Territory as a "gathering place" for those Latter Day Saints who chose to follow his leadership rather than that of Brigham Young or other claimants.

These have not been conducted since Strang's lifetime due to a lack of prophetic leadership, though the Strangites still believe in the validity of this doctrine, as do members of the LDS and certain other Mormon factions.

Because land prices in the Voree area were high, it was difficult for church members to "gather" to the settlement and purchase farmlands.

Most of his members followed him where he was crowned the Mormon king of Beaver Island, though a small minority elected to remain in Voree.

Opposition in Beaver Island ultimately led to the fatal wounding of Strang in June 1856; he returned to Voree, where he died weeks after the shooting.