Kaye's career is primarily based in the UK, but he has performed at comedy festivals internationally, including in Melbourne, Montréal, and Edinburgh.
Since 2019, Kaye has hosted the comedy podcast Come to Daddy, in which he interviews other comedians, and has made numerous appearances on television as well as having a role as a voice actor an animated film in 2024.
[citation needed] His first solo show, Success Story, debuted in 2017, and was performed at the Perth and Adelaide Fringe festivals.
[16] In 2023, Kaye appeared on an episode of the Channel 10 news and talk show programme The Project, where he controversially joked about Jesus: "I love any man who can get nailed for three days straight and come back for more!
[18] He received significant backlash for this both from publications like the Daily Mail, as well as from social media users, some of whom sent him death threats.
[19] Since 2019, Kaye has hosted Come to Daddy, a podcast about the parental upbringing of various comedian guests, including Rosie Jones, Desiree Burch, and Daniel Sloss.
[21] Kaye has also guested on numerous other podcasts, including Jordan Gray's Transplaining, Catherine Bohart and Helen Bauer's Trusty Hogs, and Abigoliah Schamaun and Joe Wells's Neurodivergent Moments.