Including the Nets, he played with the Atlanta Hawks, New York Knicks, Chicago Bulls, Miami Heat, Sacramento Kings and Los Angeles Lakers over a 12-year career, retiring after the 1991-92 season.

He had his best years with the Atlanta Hawks and the New York Knicks in the early 1980s, then went on to become a charter member of the expansion Miami Heat.

After playing for Rollie Massimino at Villanova, he was selected by the New Jersey Nets in the fourth round of the 1980 NBA Draft.

When the Nets waived Sparrow in training camp, he turned to the Continental Basketball Association, where he latched on with the Scranton Aces.

Coach Kevin Loughery made him an immediate starter at point guard, and Sparrow never looked back.

The Knicks posted a 47–35 record, beat the Detroit Pistons in the opening round of the playoffs, and then fell to the Boston Celtics in a tough seven-game series in the conference semifinals.

At the end of the 1985–86 season Sparrow was recognized for his efforts when he and the Lakers' Michael Cooper were named co-winners of the J. Walter Kennedy Citizenship Award.

Early in the 1987–88 season the Knicks traded Sparrow to the Chicago Bulls, where he played sparingly as a backup to Michael Jordan and Sam Vincent.