In 1874, the Independent Gymnastic Club set up its equipment in a building at the corner of Rampart and Bienville Streets.

In 1890, the club constructed a new gymnasium, baths, swimming pool and held professional boxing matches at 44 North Rampart Street.

[4] In 1907, Hall of Fame trainer and coach Tad Gormley moved to New Orleans to become the physical director at the Young Men's Gymnastics Club.

Irwin F. Poche, the athletic director, began to promote health and fitness classes for businessmen.

John L. Sullivan and Roberto Durán trained there before boxing matches; Johnny Weissmuller swam in the saltwater pool; and John Havlicek and Kareem Abdul-Jabbar played basketball and gave basketball clinics at the club.

[4][11][12] Celebrities that have trained at NOAC include Alec Baldwin, Harry Connick Jr., Kevin Costner, Tom Foley, Clark Gable, Jimmy the Greek, Phil Harris, Bob Hope, Kate Hudson, Frankie Laine, Jude Law, Art Linkletter, Sean Meenan, Louis Prima, Liv Tyler, Mark Wahlberg and Tennessee Williams.