Pitchers are traditionally the weakest-hitting player in the lineup, yet three hurlers with more than 2,500 plate appearances accrued higher career batting averages than Bergen: Pud Galvin with .201, Bobby Mathews with .203, and Cy Young with .210.

In 1909, Bergen hit .139, the lowest average in history for a player with the minimum number of plate appearances to qualify for the batting title.

Throughout his 3,229 career plate appearances, Bergen was never hit by a pitch, a major league record that stood for over 85 years until broken by Mark Lemke in 1997.

In 1909, Bergen set another record for futility with a span of 45 consecutive at-bats without a base hit, which at the time was the longest streak ever by a position player (non-pitcher).

Charles Faber, in his book Baseball Ratings, called Bergen the third-best defensive catcher in history, behind Gabby Hartnett and Pop Snyder, and ahead of Johnny Edwards and Roy Campanella.

[7] By the measure of win shares, Bergen was the second best defensive catcher in the majors during his career, trailing only Ossee Schreckengost of the Philadelphia Athletics.

By comparison, the following Hall of Fame catchers reached 100 assists in a season the following number of times (despite in most cases playing far more games each season than Bergen): Johnny Bench (1); Yogi Berra (0); Mickey Cochrane (0); Ray Schalk (10); Roger Bresnahan (6); Roy Campanella (0); Gary Carter (4); Bill Dickey (4); Carlton Fisk (0); Gabby Hartnett (2); Ernie Lombardi (0); Rick Ferrell (0); and Buck Ewing (4).

His brother, Marty Bergen, was a big-league catcher for the Boston Beaneaters, and suffered from severe mental illness.