The next year, he moved to Rushville, Illinois where he edited a newspaper and speculated in real estate in addition to his legal practice.

Although camped near the front line when the battle begin, it was in no significant actions during the engagement and lost only six enlisted men wounded.

Leading a cavalry expedition, he ran into the rear of Earl Van Dorn's force, but failed to engage or disrupt the Confederate movement.

Van Dorn then led his men into Holly Springs, temporarily capturing Grant's logistical base and destroying much materiel.

Dickey was elected a justice of the Illinois Supreme Court in December 1875 and held that office until his death in Atlantic City on July 22, 1885.