The Baltimore Orioles in the minor level International League were at the football field since 1944 when a tragic fire burned down their Oriole Park wooden stadium on the northwest corner of Greenmount Avenue and 29th Street and so the minor league "Triple AAA" level Birds relocated to the 33rd Street 1922 football bowl for the rest of the 1944 season and starting in 1945 for temporarily the next decade until razing began in 1949.

Then the reconstructed stadium project was put on a crash completion schedule in 1952–1953, when the city also almost simultaneously acquired a Major League Baseball level team in November 1953 for the first time in a half-century, buying out the previous owner when the St. Louis Browns relocated east to Maryland and were renamed the new Baltimore Orioles in the American League and opened their first season here in April 1954, just as the newly rebuilt Memorial Stadium was nearly completed and ready, soon making the Waverly and Greenmount Avenue communities busy and crowded even more than in previous decades on game days.

As wealthy residents began building summer cottages there in the late 19th century, a firehouse, town hall and post office were added to the community.

[2] Baltimore schoolteacher and poet Lizette Woodworth Reese's Waverly, A Victorian Village (1929) uses poetry and anecdotal prose to depict the neighborhood around the start of the 20th century.

Founded in 1971 and first renovated in 1986, the 2015 project added 3,000 square feet, 35 additional public computers, and an enlarged community meeting room to the branch.

Another notable Waverly resident was Major Richard M. Venable, a lawyer who wrote a standard legal textbook and dedicated much of his personal time to improving Baltimore's public parks.