He credits his music career to the mentorship of two older African-American performers: Nat Riddles, a New York harmonica player who had worked with Odetta and Larry Johnson; and guitarist Sterling Magee.

They released five albums: Harlem Blues (1991), Mother Mojo (1993), Living on the River (1996), Word on the Street (2008), and Back in the Game (2011).

(David Nelson (September 10, 1996), Living Blues, #129)[full citation needed] In August 2010, Gussow released his first solo album, Kick and Stomp, which features him as a one-man band, playing harmonica and percussion.

[4] From 2010 to 2012 Gussow co-organized and produced Hill Country Harmonica, a teaching-intensive event at Foxfire Ranch in Waterford, Mississippi, with an evening concert component.

A feature-length documentary about Gussow's decades-long partnership with Magee, entitled Satan & Adam, directed by V. Scott Balcerek premiered at the Tribeca Film Festival in April 2018.