Richardson took over as Astro general manager after his two predecessors, Paul Richards and Tal Smith, had built one of the most talented farm systems in baseball.

In its five-year history, the Houston franchise had produced star players Rusty Staub, Joe Morgan, Jimmy Wynn, Larry Dierker and Dave Giusti, with future standouts Doug Rader and Don Wilson ripening in its minor league system.

Cuellar appeared in three consecutive World Series with the Orioles from 1969 to 1971 including a 1970 Championship run, was a co-recipient of the American League Cy Young Award in 1969, had at least 20 wins in each of four seasons and won 143 games in eight years in Baltimore.

[2][3] Richardson then traded Staub — a 24-year-old outfielder and first baseman who displayed remarkable ability to hit for high average and decent power (leading the league in doubles in 1967) within the confines of the cavernous Astrodome — to the Montreal Expos for Jesús Alou and Donn Clendenon.

To his credit, Richardson recognized César Cedeño as a potential superstar, but the Astros spent his tenure and several years after it mired in mediocrity.

On July 11, 1975, with Houston at 32–58 and lodged in last place in the National League West Division, Richardson was fired and soon replaced by Smith, who returned to the Astros after a stint as an executive with the New York Yankees.

Led by slugger Jack Clark and pitchers Vida Blue and Bob Knepper, the 1978 Giants posted an 89–73 record to finish a strong third in the NL West, only six games behind the eventual league champion Los Angeles Dodgers.

Richardson was demoted from his general manager position on July 7, 1981 and replaced by Tom Haller who had been the team's director of player development.