It is located at 111 Main Street, in a fine Victorian Romanesque Revival building erected in 1891, funded by a bequest from Winchester resident Ezra Conant.

The main facade has a centered projecting entry section with a gabled roof, with the entrance deeply recessed under a large rounded arch.

The projecting section is flanked by paired round-arch windows, with granite sills and with arches of alternating soldier bricks in buff and red.

This collection was first housed in a commercial building on Main Street, which was soon deemed to be inadequate for the purpose.

The town received a bequest in 1889 from Ezra Conant, a Winchester native who had made his fortune in the leather business, for $50,000 to cover the cost of a new library building.