Probably built in first quarter of the 19th century, it was long been associated with the nearby ferry service to Plattsburgh, New York, and is one of the town's few surviving 19th-century stone buildings.

[1] The Gordon-Center House stands on the east side of West Shore Road, north of the Gordon's Landing ferry terminus and just south of the Ed Weed Cultural Fish Station.

It is a 2+1⁄2-story stone structure, built out of ashlar granite and coursed rubble, with a side-gable slate roof and two interior chimneys.

[2] Apparently completed in 1824, the interior has retained a few Federal style details despite fairly extensive alterations early in the 20th century.

The building was long been associated with the ferry service operated, and tradition has it that its construction was begun by Hazen Bell and completed by someone named Boardman.