He was in private practice in Cincinnati from 1880 to 1893, and was an assistant prosecuting attorney of Hamilton County, Ohio from 1881 to 1882.

He was a Judge of the Court of Common Pleas for the 1st Judicial District of Ohio from 1893 to 1903.

[1] On February 24, 1910, Hollister was nominated by President William Howard Taft to a new seat on the United States District Court for the Southern District of Ohio created by 36 Stat. 202.

He was confirmed by the United States Senate on March 7, 1910, and received his commission the same day.

[1] Hollister was married to Alice Keys of Cincinnati on June 2, 1887.