Goldberg co-produced albums by Percy Sledge, Charlie Musselwhite, James Cotton, and the Textones, plus Bob Dylan's version of Curtis Mayfield's "People Get Ready".

Goldberg's songs (some co-written with Gerry Goffin) have been recorded by many musicians, including Rod Stewart, Gladys Knight, Joe Cocker, Steve Miller, Bobby "Blue" Bland, Gram Parsons and B. J. Thomas.

Goldberg's first professional recording session was "Devil with a Blue Dress On"/"Good Golly Miss Molly" by Mitch Ryder & the Detroit Wheels.

Among the albums he contributed to are Leonard Cohen's Death of a Ladies' Man, the Ramones' End of the Century, The Flying Burrito Brothers' The Gilded Palace of Sin, and Super Session, which featured Michael Bloomfield, Stephen Stills, and Al Kooper.

In 1992 he played keyboards with the Carla Olson & Mick Taylor band, which resulted in the live CD Too Hot for Snakes, featuring Ian McLagan, Jesse Sublett and John "Juke" Logan.

In 1994, Goldberg and Saul Davis produced Blue Night by Percy Sledge, which featured Bobby Womack, Steve Cropper, Mick Taylor, Greg Leisz, Bob Glaub, Ed Greene, and Mikael Rickfors, with songs written by Rickfors, Gregg Sutton, Pat Robinson, Carla Olson, the Bee Gees, Quinton Claunch, Fats Domino, and Otis Redding.

In 2004, Shining Through The Rain by Percy Sledge was co-produced by Davis and Goldberg, featuring Larry Byrom, Denny Freeman, Clayton Ivey, Ed Greene, Phil Upchurch, Bob Glaub, the Waters, and Jakob Dylan, and songs by the Bee Gees, Mikael Rickfors, Carla Olson, Jackie Lomax, Earl Carson, Bobby Moore.

Goldberg produced three tracks on the 2013 EP (Drown in the Crimson Tide) by The Voice Season One semi-finalist Nakia with longtime friend Johnny Lee Schell.

Goldberg appears on the RENEW / BMG album Americana Railroad, released November 26, 2021, backing Rocky Burnette and James Intveld.