The eldest son acted as Stone's private secretary, and the youngest attended the preparatory department of Columbia College.

The second daughter, Ann, was an interesting young woman and a favorite in Washington society and attended school near Philadelphia and afterwards traveled in Europe.

Stone was elected as a Republican to the Fifty-first Congress to fill the vacancy caused by the death of Lewis F. Watson.

He served as chairman of the United States House Committee on Coinage, Weights, and Measures during the Fifty-fourth and Fifty-fifth Congresses.

The Honorable Charles Warren Stone Museum was added to the National Register of Historic Places in 1976.