Scammon, a native of Whitefield, Maine, was appointed from his district to the United States Military Academy in West Point, New York, graduating 9th in the Class of 1837.

Due to his ranking and abilities, he was selected as one of the original officers in the newly created U.S. Army Corps of Topographic Engineers in 1838.

Scammon was appointed brigadier general of volunteers in October 1862, and fought in the major actions of the Kanawha Division.

Young Scammon, became one of the wealthiest men in America as a Chicago attorney, newspaper owner, philanthropist and businessman.

Another brother, Charles Melville Scammon is a famous whaleman, naturalist and author of Marine Mammals of the Northwestern Coast of North America (1874).