Gómez was born in New York, to Cuban American parents, the son of Cora Gomez.

He has, among other roles, guest-starred as a repeating support villain on the hit television show Charmed as the San Francisco Police Department (SFPD) Internal Affairs Department Inspector (and undercover demon) Rodriguez pressuring the regular character Andy Trudeau.

Carlos can also be seen in the CBS drama Shark, where he plays Mayor Manny Delgado, alongside James Woods and Jeri Ryan.

Gomez appeared in the 2008 Broadway musical In the Heights as Kevin and was a cast member of the A&E television series The Glades for all four seasons.

In 2020, Gomez was cast as Rafael Garcia, the lead character's father, in the ABC romantic comedy-drama series The Baker and the Beauty.