Returning to Rindge, he devoted himself to study, was connected with prominent publishing firms in Boston, New York and Philadelphia, and in 1876 and 1877 was manager and editor-in-chief of the Chronicle at Fitchburg, Massachusetts.

According to The National Cyclopaedia of American Biography, "Stearns took up its work with an accurate knowledge of its varied duties and familiarity with the state archives.

For many years he manifested a lively interest in genealogy and in  local history, contributed many excellent sketches and addresses to the literature of those subjects.

[4] The following sonnet, which was written by Herbert Ingalls, a friend and former fellow-townsman of Stearns, was printed by the Fitchburg Daily Sentinel to mark the occasion: Sonnet—To a Historian[To E. S. S.]His work was done by conscientious toil'Mongst faded manuscripts and time-worn books,By faithful searches in forgotten nooks,And earnestness which hindrance could not foil:By frequent burning of the midnight oil,By careful thought which seldom overlooksA clue to truth, and never fully brooksDefeated purpose.

Children of the soilWhose records thus are rescued from decayCannot but thank the patient, constant mindThat journeys down an ever-darkening wayTo gather up its scattered lore, and bindRemotest annals to a future day,And moves clear-sighted where ourselves were blind.