Zalmon was born in 1811 in Cummington, Massachusetts, to Nehemiah and Elizabeth (née Packard) Richards.

"[2] His father was a farmer and descendant of English emigrant William Richards, a Plymouth colonist.

[3] Richards became interested in education and religion due to the influence of his first teacher, Sybil Bates.

[4] Around this time Richards heard a lecture on temperance and made a vow to never consume alcohol, which according to him, he kept.

Richards' family was unable to assist paying his tuition, so he continued teaching during college breaks and borrowed money which he later repaid.

[4] After graduation, Richards returned to his alma mater, Cummington Academy, but this time as principal.

During his nine years at this academy, Richards also organized normal schools in Saratoga County, New York, and at the request of Governor Horace Eaton, in Vermont.

[1] In 1852, Richards founded a private school, Union Academy, which was successful until Southern students left at the outbreak of the Civil War.

[4] In reference to the NEA, Richards said: "There is not a state, county, city or town in all our country where the influence of our associational work is not more or less felt.

"[5] During the Civil War, Richards was involved with the Christian Commission, visiting sick and wounded soldiers in local hospitals.