Like Chamberlain he was hired as a teenager by Haskell Cohen to work and play basketball at Kutscher's Hotel, a resort located in the Catskill Mountains, where he was also in close regular contact with hall of fame basketball coach Red Auerbach.

[4] Scott played for the Allentown Jets of the Eastern Professional Basketball League (EPBL) from 1958 to 1961.

[8] As a Bullet, he was close friends with Naismith hall of famer Gus Johnson; gave Freddie "Mad Dog" Carter his nickname; and said of the great guard and fellow Philadelphian Earl Monroe that no one, human or divine, could go one-on-one with Monroe.

[8] Scott was selected by the Buffalo Braves in the 1970 expansion draft, but instead chose to play for the American Basketball Association's Virginia Squires (from 1970 to 1972),[8] where he was a teammate of Julius Erving.

To Scott's surprise, he was promoted from assistant to head coach of the Pistons on October 28, 1972, succeeding Earl Lloyd who was fired after a 2–5 start.

[10] Scott was appointed men's basketball head coach at Eastern Michigan University just over six weeks later on March 10, 1976.

After his coaching career, Scott went into private business, spending 30 years as an insurance executive.

[8] He also has held the position of ambassador for children and families for the Wellspring Lutheran service agency in Michigan.

[13][14] In November 2017, Scott was inducted into the Philadelphia Black Basketball Hall of Fame, in its inaugural class.

They met during his coaching of the men's basketball team at Eastern Michigan University in Ypsilanti.