As a youth, Brown played for Sheffield Schoolboys and Carbrook Reform.
In 1923, Brown moved back to his native Yorkshire to sign for Barnsley.
In two years with the Tykes, Brown made twelve League appearances.
After leaving Swindon, he moved into non-League football in the Manchester area, initially with Hurst.
In November 1929, Brown signed for Manchester Central, where he stayed for three years before moving to Stalybridge Celtic in 1932.