He was born in Kenosha, Wisconsin and was the eldest son of Edward Leslie and Josephine Ellen Richmond.

His father who was a railway mail clerk moved to Washington, D.C., and joined the Government Printing House there.

During his early life he earned extra income for the family by leaving school and working as a page in the House of Representatives.

[1] In 1888, Richmond took part in a United States Geological Survey expedition to Montana.

[2] After a collecting trip to Nicaragua he joined the staff of the United States National Museum in Washington, D.C., as a nightwatchman.