He served as the head football coach at University of Georgia in 1893 and Pittsburgh Catholic College of the Holy Ghost—now known as Duquesne University—in 1896.

[2] In the fall of 1891, Brown accepted an unspecified position at Shortlidge Academy of Media, Pennsylvania[3] and played on the school's football team.

[4][5] He acquired his nickname "Rags" in a game that season against the Pittsburgh Athletic Club, as recounted years later by The Pittsburg[h] Post: He was the whole Media team, and went through P.A.C.

[16][17] Brown served as football head coach for the Pittsburgh College of the Holy Ghost (later renamed Duquesne University) for one season in 1896.

[18] Grove City College lists its head football coach in 1897 as "Rags" Brown, ascribing to him a record of 5–1–1.