A Balmain junior, Brown made his first grade debut for the club in Round 9 1938 against St George at Earl Park, Arncliffe.
The following year in 1939, Brown only made 1 appearance and missed out on playing in the club's premiership victory over South Sydney.
In 1941, Brown made 4 appearances as Balmain won the minor premiership but fell short of another grand final.
The following season, Brown was part of the Western Suburbs side which won the minor premiership and reached the 1948 NSWRL grand final against Balmain.
In the second half, a long range try scored by Wests player Kevin Hansen gave Western Suburbs an 8–5 lead which they held onto until the end of the match winning their third premiership in front of 29,122 fans at the Sydney Sports Ground.