First built in 1901, the building gained significance when Theodore Roosevelt had his staff take offices here while he served as U.S. President.
It began as a one-story structure, made mostly of wood with a section of brick on the front wrapping around each side for about 10 feet (3.0 m).
Mr. Moore also built a row of attached wood buildings extending up East Main Street, which housed various shops such as Oyster Bay's first ice cream parlor, a furniture store, and an undertaker.
But these upper floors were to rise to ever greater fame - when President Theodore Roosevelt outgrew his suite of offices at the Oyster Bay Bank Building on Audrey Avenue.
Secretary Loeb installed telegraph and telephone "hotlines" which connected directly to Sagamore Hill and the White House in Washington, D.C., and in 1903, the first "round the world" cable was transmitted from this building.