During his playing days, Brown stood 6 ft 1 in (1.85 m) tall, weighing 190 lb (86 kg).

His younger brother, Jackie Brown, was a big league pitcher and pitching coach.

Brown spent all but seven games of his entire eight-year (1960–1965, 1967–1968) professional baseball career in the Phillies' system.

In parts of four MLB seasons, he posted an 0–8 record, with a 6.00 earned run average (ERA), in 36 appearances, including 12 starts and one save.

Brown surrendered 62 earned runs, on 108 hits, and 47 walks, while striking out 45, in 93 innings pitched.