After the war, Daugherty returned to live in Maryland, where he encountered Jim Crow laws that segregated African Americans from whites in many aspects of life.
He had very mixed feelings about serving in the military, due to the reality of living under Jim Crow laws that deprived him and other African Americans of many of their civil rights and liberties.
Still, he reported for duty, and was assigned to the all-black 92nd Infantry Division, known from its World War I nickname as the Buffalo Soldiers, a term given to African-American troops by Native Americans during the late 19th century.
He describes the surprise that other soldiers had at seeing him walking around afterwards with a bright shard of steel shrapnel, which he had received during the barrage, sticking out of his helmet, and which came within 1/4 of an inch (0.6 cm) from penetrating his skull.
He also had a distinguished career working for the United States Public Health Service in administrative capacities, as well as serving for many years in a governor-appointed position with the Maryland School for the Deaf.
[2] Daugherty himself received the Bronze Star Medal for heroic achievement, and a Combat Infantryman Badge for outstanding performance of duty in action against the enemy.
"[3] Finally, after years of having the manuscript lying sealed away, in 2009 Daugherty published his autobiography through self-publishing service Xlibris promoted it, including being interviewed on the National Public Radio program All Things Considered.
After his book was published, his home town of Silver Spring, Maryland, officially declared July 28 as "Buffalo Soldier James Daugherty Day".