[2] The town is named after Claudius Victor Boughton, an American hero of the War of 1812.

The tribe abandoned the village and the area about it after being severely attacked in 1687 by French invaders from Canada.

In 2015, New York opened a museum and cultural center on the grounds of the Ganondagan State Historic Site, established in 1987.

The Seneca Art & Culture Center at Ganondagan will use art, history and education, drawn from oral history, written documents, and archeological evidence, to tell the story of the Haudenosaunee (Iroquois) people, and specifically the Seneca nation.

Following the American Revolutionary War, the Phelps and Gorham Purchase from the Seneca included the territory of this town.

The Jeremiah Cronkite House, Cobblestone Railroad Pumphouse, Felt Cobblestone General Store, Boughton Hill, Osborne House, and Valentown Hall are listed on the National Register of Historic Places.

The western and northern town lines are the border of Monroe County (Perinton and Mendon).

New York State Route 96 is primarily an east-west highway, but turns north to the west of Victor village.

New York State Route 251 connects the western part of Victor to Monroe County.