He also starred in films, Harley Davidson and the Marlboro Man (1991), Hero (1992), Mulholland Falls, Trees Lounge (both 1996), Vampires, Phoenix (both 1998), Paparazzi (2004), Sidekick (2005), The Beach Party at the Threshold of Hell (2006), and Grey Gardens (2009).

He returned to TV movies such as Attack of the 50 Ft. Woman, Family of Cops, and Twisted Desire, as well as the 1996 feature films Mulholland Falls and Trees Lounge.

In 1998, Baldwin was set to film the romantic comedy It Had to Be You,[11] but was replaced by Michael Rispoli after being arrested for cocaine possession.

Baldwin was cast as Menelaus in the BBC One show Kings and Pharaohs for Series 1, featuring Christopher Eccleston, Michael Rooker and John Hurt.

Baldwin then starred in TV movies such as Anonymous Rex (2004) and Our Fathers (2005) and small-budget films including Sidekick (2005) and Moola (2006).

In 2008, Baldwin signed on to play Julius Krug in the Award Winning HBO film based on the 1975 documentary Grey Gardens.

[13] The documentary was made by actress Namrata Singh Gujral and featured breast cancer survivors Olivia Newton-John, Diahann Carroll, Melissa Etheridge, Namrata Singh Gujral, Mumtaz and Jaclyn Smith, as well as Priya Dutt and Baldwin's brother William.

He was the team captain of the Eastsiders, which also featured rapper Biz Markie, plus-size model Mia Tyler, and actor Joe Gannascoli (later traded for Judge Mablean Ephriam from Divorce Court).

[16] Following the couple's divorce, Baldwin was involved in a lengthy relationship with his Homicide: Life on the Street co-star, Isabella Hofmann.

[28] He joined WTLA in Syracuse in September 2017[5][6] and left the station in April 2019, stating that he had accomplished what he wanted to do with the radio show.

[29] In 1998, Baldwin was found running naked through the halls of New York's Plaza Hotel shouting his own last name and was arrested for possession of cocaine.

[33] On November 7, 2006, Baldwin was arrested in Santa Monica, California, after allegedly stealing a white GMC Yukon SUV.

"The car belongs to an acquaintance of Mr. Baldwin, but he had no permission to take it", said Jim Amormino, a spokesman for the Orange County Sheriff's Department.

On February 6, 2007, an arrest warrant was issued for Baldwin in Newport Beach, California, by the Orange County Superior Court for his failure to show up for an arraignment stemming from an auto-theft charge.

It was eventually reported that he left because of inappropriate text messages he had sent to Mary Carey, a fellow patient in his treatment group.