There was a resolution offered by William M. Oliver and it was adopted and it read ‘Resolved, That it is expedient to organize and form a County Historical Society for the purpose of collection and preserving the memorials of the early settlement of the county and of the early settlers and all other facts connected with the history of the county, including Indian antiquity and history, and that the necessary measures be taken for the purpose.”[3] A group of 32 men from the nearby towns of Milo, Benton, Jerusalem, Middlesex and Potter signed the resolution.
Evidence of the activity of the Society becomes scarce until the twentieth century until a newspaper article in 1915 that brought it back to life: “Yates County is full of historic relics of which should be preserved.
There are articles innumerable scattered throughout the community which are associated with the early history of the county and which would make an invaluable collection if they were brought together.
In 1926 the editor of the Penn Yan Democrat asked the question: What do you think of organizing a historical society in Yates County?
At the end of the article, which was on the front page he listed names of men and women who had expressed interest in performing this task.
The Yates County Genealogical and Historical Society offer a collection of three museums located in the village of Penn Yan, New York.
Andrew Ferguson Oliver married Margaret Sutphen and gave the house as a wedding present to their son William.
[9] The Yates County Genealogical and Historical Society operate it as museum keeping many of the portraits and original furnishings of the house while also having a changing exhibit.
[11] The Oliver Fund was administered by the village board and used only for the property and not for the operation of the genealogical and historical society, all the money was used for plumbing and the redecorating of the house.
[6] The Scherer Carriage House is located behind the Underwood Museum and is the home to the exhibit of evangelist known as the Public Universal Friend, who formed the first white settlement in what is now Yates County.