While living in Galena, Rowley was a neighbor and good friends with Ulysses Grant and John Rawlins before and at the time the Civil War broke out.

[2] Notable people such as Ulysses S. Grant, John Rawlins and Illinois Congressman, Elihu B. Washburne, were among Rowley's neighbors and were residents of Galena at the time.

[4] When the Confederates attacked Fort Sumter on April 12, 1861, and the news reached Galena the day after, Rowley was among the roused gathering that assembled in town.

[c] At that time Rowley represented Grant's strongest tie with his Republican supporters in Galena, especially Elihu B. Washburne.

Due to the surprise of his army and the consequent heavy loss of life at Shiloh, General Grant was strongly criticized in many Northern newspapers.

He rode on further and found General Wallace at the head of his column near Clear Creek, positioned on high ground.

[13][17] Later, in his Autobiography, Wallace wrote about his encounter with Rowley, how he realized he was at the rear of the entire Confederate army, and how he was stunned by the news.

When he was at Donelson he made himself so obnoxious that Gen Grant issued a special order, directing him to be removed outside of our lines, and to remain there.

[1]Several days later, Rowley wrote directly to Washburne about the misgivings concerning the battle, although the primary reason for the letter was to recommend the promotions of Grant's aides Clark B. Lagow and William S. Hillyer to colonel.

Head Quarters Army of the TennesseePittsburg April 23d 1862 Friend Washburne I have intended ever since the Battle at this place to have written you a letter, but the hurry and confusion incident to such a fight as we have had prevented ... it.

... First however a word with reference to the Thousand and one stories that are afloat with reference to Gen Grant suffice it to say they have the same foundation as did those that were circulated after the Battle of Donelson and no more: It is sufficient to say that Gen Halleck is now here and the conduct of the Battle and all the details meet his entire approbation and the stories in circulation have their origin in the efforts of Cowardly hounds who "stampeded" and now would be glad to turn public attention from themselves, and direct it elsewhere, together with the eagerness of Newspaper Correspondents to get items I who was on the field know that had it not been for the almost superhuman efforts of the Gen' added to the assistance he had from his officers we would have been forced to Record a defeat instead of one of the most Brilliant victories that was ever won on any field ...

[h] He remained in that position until his health began to fail in October of that year, after the Wilderness campaign, forcing him to resign from the army.

[2] He remained friends with fellow soldier Wilbur Crummer with whom he often talked about events they shared together during the Civil War.

Crummer, in his 1915 book about the battles of Fort Donelson, Shiloh and Vicksburg, noted that enemies of Grant circulated stories about his alleged drinking, and wrote of Rowley, that any time the subject came up, it would prove to be "the spark that exploded the magazine of wrath and where Rowley would typically reply: "All a damned lie", sentiments that were also shared by Crummer.

[27] In June 1880, while the Republican Convention was in session in Chicago, former general and president Grant and his family were living in Galena.

After being persuaded by his wife and political friends to stand for a nomination and run for office a third time, he finally consented.

Grant would come down town in the morning on a daily basis and would spend an hour or two with Judge Rowley, now an old friend and former comrade, at his office, and would often talk about his recent tour around the world.