[3][4] His father is Jewish, while his mother is a non-practicing Catholic of German, French, Irish,[5] and a "bit of Mexican" descent.

His career-making role was arguably that of the tough, wise-cracking infantryman Stanley Mellish in Steven Spielberg's 1998 film Saving Private Ryan.

Goldberg has also voice acted in Babe: Pig in the City, Homeward Bound II, and A Monster in Paris.

Goldberg wrote, produced, directed, and edited the features Scotch and Milk, I Love Your Work, and No Way Jose as well as multiple television projects, notably including the philosophical travelogue Running with the Bulls for IFC.

In 1995, Goldberg appeared in a signature wise-cracking role as delivery boy Leo in the television comedy Double Rush.

[10] Goldberg appeared in the short-lived ensemble cop show The Unusuals, playing a New York City detective with brain cancer who refuses treatment because of his dislike of doctors.

He had to learn American Sign Language for the role and began production just a few days after wrapping principal photography on his feature, No Way Jose.

In 2019, Goldberg had a supporting role in the cast of CBS's God Friended Me as technical entrepreneur, Simon Hayes.

A multi-instrumentalist and songwriter, Goldberg composed and arranged the music to the film I Love Your Work with Steven Drozd of The Flaming Lips as well as scoring his most recent feature, No Way Jose, and IFC's Running with the Bulls.

Flaming Lips drummer Steven Drozd, with whom Goldberg collaborated on the score for I Love Your Work, performed on the record as well as members of the band The Black Pine.

His first book was co-published by Hat and Beard Press and contained a limited vinyl version of The Goldberg Sisters' Home: A Nice Place to Visit.