The original house was built of excess stone excavated for the Erie Canal.

The house was said to have been a part of the Underground Railroad, with many runaway slaves using it as refuge.

In about 1900, a large, two-story, rear brick wing was added to accommodate orphaned children of the Independent Order of Odd Fellows members.

It is believed that the Niagara grape was developed on a portion of the over 800 acre Comstock farm, sold to Obadiah P. Hoag about 1825.

Claudius L. Hoag, son of Obadiah traveled to Canada to learn how to hybridize grapes.