In the middle of the 1984–85 season, Williams signed as a free agent with the Boston Celtics, in exchange for two future draft picks.

Before the 1985–86 season, Williams signed with the Los Angeles Clippers, with Boston receiving a future draft pick as compensation.

[3] After his retirement, Williams struggled financially, eventually filing for bankruptcy in 1994, which led him to lose his home and family.

After he received it, he moved to Florida, where he fell victim to a real estate scam that worsened his financial condition.

After that, Williams worked various jobs like groundskeeper at a golf course in Central Florida, apartment complex maintenance man, part-time girls basketball coach, and bakery worker, among others.

During that time, he also received grants from the NBA Retired Players Association, totaling $10,000, which couldn't help his situation.

According to a profile published in The Boston Globe in July 2010, he was unemployed and homeless, living inside a car in Pompano Beach, Florida.

Williams spent his time fishing at the Hillboro Inlet Park in Pompano Beach, to help maintain himself.