Born in Dalkeith, Brown left school at eleven and began working at the local colliery.
He became an active trade unionist, and in 1890 was elected as secretary of the Mid and East Lothian Miners' Association.
[1] In 1894, Brown was a key mover in creating the Scottish Miners' Federation (SMF), and was elected as its second secretary, soon after its formation.
The SMF affiliated to the Miners' Federation of Great Britain and Brown served on its executive on several occasions.
[1] Brown was elected to Dalkeith Burgh Council as a member of the Liberal Party and served as provost on three occasions.