He started a business in Madison, Georgia, forming the firm, High & Berney.
He later moved to Atlanta for greater opportunity, where he partnered with E. D. Herring to open up a dry goods store at 40 Whitehall Street (now Peachtree St.
By 1889, High was able to buy the southwest corner of Whitehall and Hunter (now King Blvd.)
and erect a four story brick building with an ornate interior for his department store.
[5] From 1926-1927, High's was home to a broadcasting studio of radio station WDBE.