Lee was born on Long Island, New York in 1840[1][2] but his family moved to Buffalo while he was still a small child.

The Civil War had broken out by the time he returned to the United States and he enlisted in the U.S. Navy, reporting for duty at Boston.

[1] On June 19, 1864 he was serving as a Seaman on the sloop of war USS Kearsarge when she fought the commerce raider CSS Alabama off Cherbourg, France.

[2] Lee didn't learn about his commendation until after he was discharged from the Navy, and said he had no idea what he had done during the battle to distinguish himself so highly.

1 gun during this bitter engagement, Lee exhibited marked coolness and good conduct and was highly recommended for his gallantry under fire by the divisional officer.