In 1889, while he was a player-manager for a team in Evansville, Illinois, he suffered partial paralysis during a game; acute rheumatism was diagnosed as a cause.

[3] He continued with the team into the 1884 season when he was signed by the St. Louis Browns of the American Association (AA), and made his Major League Baseball debut on May 29, 1884.

[5] On August 2, the Evening Star opined that the Nationals' outfield, now consisting of Goldsby, Frank Olin, and Willie Murphy, had made a significant improvement.

[8] In August, he issued a fine of $25 to pitcher Ed Dundon, who was a deaf-mute; Goldsby feeling that he had intentionally allowed an opposing player to hit a home run.

He had the best season of his minor league career, batting a .422 average, scored 112 runs, hit 13 doubles, and nine triples.

[8] After a meeting of SL officials in New Orleans, it was determined that league would be accepted into the National Agreement and agree to respect the reserve clause.

However, the teams were not able to contribute the money necessary to bind the agreement and secure the right to reserve their own players, so many of them decided to take larger offers from other leagues.

During the previous season, in a game against the Philadelphia Athletics, he was hit the head with a ball, causing him to lose consciousness.

[18] On January 11, 1914, Goldsby committed suicide in a Dallas, Texas hotel called the "Campbell House", by a self-inflicted shot to the head with a .45 caliber revolver.

He had been registered as a resident of Dallas, and left a lengthy suicide note detailing general despondency.