He continued his studies at an Atlanta, Georgia business college and became a clerk with the Western and Atlantic Railroad.

During his career at the railroad he rose to the position of traffic manager for the company, and he married Cora Annie McCord.

In 1904, Brown was appointed to the Georgia State Railroad Commission by then-Governor Joseph M. Terrell.

That appointment was rescinded in 1907 when the new Governor, Hoke Smith, removed Brown over disagreements about passenger fares.

Smith left before the end of his second term to assume the United States Senate seat that became vacant upon the death of Alexander S. Clay, and Brown ran unopposed to become Governor again for the rest of Smith's original term.