The library occupies a single-story wood-frame structure built in 1845 as a church for a Universalist congregation.

Despite significant alteration for its use as a library, the building remains a fine example of vernacular church architecture in Sullivan County.

The main facade is three bays wide, with a center entrance framed by simple moulding with corner blocks.

The building was formally dedicated in 1927 to the memory of Lempster native Alonzo Ames Miner, a leading Universalist minister and president of Tufts College.

By the late 1940s the congregation had shrunk to the point that only summer services were held here, and in 1964 its trustees offered the building to the town.