He received an Artium Baccalaureus degree from Ithaca College in 1981 and a Juris Doctor from Temple University Beasley School of Law in 1986.

He became an Assistant United States Attorney in the Eastern District of Pennsylvania in 1997, serving in that position until 2003 when he was elected to a judgeship on the Bucks County Court of Common Pleas.

He also taught as an adjunct professor at Temple University Beasley School of Law from 2002 to 2006.

Goldberg was confirmed by the United States Senate by voice vote on September 26, 2008, and he received his commission on October 31, 2008.

On March 5, 2024, Goldberg became chief judge of the Eastern District of Pennsylvania, succeeding Juan Ramon Sánchez.