In the twenty years prior to that, the home had been used for a variety of services including: a post office, bank and shipping facility.

[10] An early proposal for saving the deteriorating building included a 1946 plan to physically move the Flag House to a resting place in Fort McHenry, however those efforts failed.

[12] Many claimed that the proposed east–west route of the cross-city Interstate 95 with an interchange connection to the southern end of the Jones Falls Expressway (Interstate 83), running through the historical neighborhoods of Federal Hill and Fells Point on either side of the harbor waterfront, would ruin the natural antique environment of the historic site home.

He also warned against ceding American sovereignty through a status of forces treaty and strongly urged in favor of the adaptation of the Bricker Amendment.

[14] In June 1961, during a dedication ceremony for the stone map, Representative Gordon L. McDonough (R., CA) stood before a crowd of 375 people and advocated for a return "to good old-fashioned American patriotism" and for adopting Flag Day as a national holiday.