[3] Herzog is active in New York City performing comedy and is a warm-up comedian for Late Night with Jimmy Fallon.

[citation needed] In 1992, he graduated from Rhodes College in Memphis, Tennessee with a degree in history and theater.

[2] Since 2004, Herzog has hosted a weekly comedy show every Tuesday night called "Sweet" that began a long-time residency at the Lower East Side bar, The Slipper Room, then moving to other downtown venues.

[6][7] A regular feature of the show is a called "What's On My Mom's Mind,"[8] during which he interviews his mother, Kera Greene.

[12] In 2013 and 2014, Herzog co-hosted Duck Quacks Don't Echo on the National Geographic channel with Michael Ian Black and Tom Papa.