From 1904 to 1936, Brown served the United States Olympic Team as a manager, official, and coach.

In 1919, he became general manager of the Boston Arena, home to indoor track meets, boxing matches, and hockey games, among other events.

In 1911, Brown formed and managed an amateur ice hockey team for the BAA, which played at the newly constructed Boston Arena.

Over the next two decades, Brown organized hockey events held at the Arena, including Canadian-American games and collegiate competitions.

In 1934 Lapham purchased the rival Garden, and named Brown as its general manager and vice president.

When professional hockey was first introduced and its teams sought to play at Boston's rinks, Brown opposed, favoring amateur competition.

Brown served as athletic director at Boston University (BU) and in 1917, was instrumental in the creation of the school's first hockey team.

He was also enshrined as a Builder by the United States Hockey Hall of Fame in Eveleth, Minnesota, in 1973.

In January 1938, the United States Olympic Committee marked his death with a moment of silence.

As general manager of the Boston Arena and Boston Garden, Brown promoted all manner of sporting events including college hockey, indoor track and field, amateur boxing, wrestling, water follies, and figure skating, featuring Olympic star Sonja Henie.

In addition to his primary passions—ice hockey, track and field, and the Boston Marathon—Brown created a BAA football team.

Brown enlisted in the 6th division of the US Navy and was appointed as director of athletics for the 1st District during World War I.

He designed an athletic competition, the Chariot Race, that allowed thousands of men to compete in teams of one hundred, first demonstrated on the Boston Common in 1917.

Brown lived in Hopkinton, Massachusetts throughout his life, married Elizabeth Gallagher, and had four sons and three daughters, who continued their father's pursuits.

Brown, assumed the general manager position at the Boston Garden upon his father's death.

Walter also served as starter of the Boston marathon from 1938 to 1942, and held the post of BAA president for over twenty years.

Like the Boston Marathon, many of the sporting events George V. Brown fostered, have continued for over a century.

In 2008, the Hopkinton Athletic Association commissioned sculptor Michael Alfano to create a statue honoring Brown.

"Boston University Terrier's Hall of Fame, John O'Hare Jr".