His parents migrated with their extended family to Kentucky to settle on lands granted his maternal grandfather Thomas Elmore, due to his service in the American Revolutionary War.

Ward studied law and was admitted to the bar, beginning practice in Greensburg, Kentucky.

Ward led a brigade in XX Corps during the early stages of the Atlanta Campaign.

After MG Daniel Butterfield went on leave, Ward commanded third division XX Corps for the remainder of the campaign including conspicuous service at the battle of Peachtree Creek.

After the war was over, he returned to the private practice of law in Louisville, Kentucky, partnering with his son Ossian T. Ward.