Born in Cincinnati, Ohio, Rubin received a Bachelor of Arts degree from the University of Cincinnati in 1942 and a Bachelor of Laws from the University of Cincinnati College of Law in 1944.

He was in private practice in Cincinnati from 1944 to 1971, working as an assistant prosecuting attorney of Hamilton County, Ohio from 1950 to 1960.

[1] On April 29, 1971, Rubin was nominated by President Richard Nixon to a new seat on the United States District Court for the Southern District of Ohio created by 84 Stat.

He was confirmed by the United States Senate on May 20, 1971, and received his commission the same day.

His service terminated on August 2, 1995, due to his death of cancer in Cincinnati.