He was the son of Thomas Yelverton (c.1845–1888), at the time of his death Clerk of Schenectady County, and Leah Little (Walker) Yelverton (1845–1899).
He attended Union Classical Institute in Schenectady.
Levi P. Morton as Treasurer of Schenectady County, to fill the vacancy caused by the death of John G. L. Ackerman.
On November 30, 1901, he married Mary Cochran (Ellis) Veeder (1864–1938), and they had a daughter, Ruth Ellis Yelverton (born 1903).
She had been married to Harmon W. Veeder who died in 1900, and had a daughter from her first marriage, Mary Elizabeth Ellis Veeder (born 1898).