This was done with the aim of providing a crossfire on any ships attempting to bombard and/or conduct an amphibious assault on Norfolk, Portsmouth, or the Gosport Navy Yard.

Patriot Whig forces made some effort to repel British landing parties, but did nothing to put out the fires and looted abandoned Tory properties.

[7] In 1794 Congress authorized President George Washington to build defensive fortifications along what they determined the "Maritime Frontier" in order to defend American harbors.

The northern, eastern, and southern facing sides are designed after a Vauban style star fort.

[11] In 1807–1809 the fort was completely rebuilt with masonry, with a capacity of 30 guns and barracks for two companies, as part of the second system of US fortifications.

Additionally, this provided needed protection to the Officers' Quarters building, (used as the Shell House during the Civil War) which also served as the center part the eastern perimeter wall.

In 1853 local historian William S. Forrest described the fort as "long neglected, and is fast falling into ruins".

The fort's newly added powder magazine also supplied Confederate ships attempting to break the Union blockade on Hampton Roads.

For the remainder of the Civil War, under Union occupation, Fort Norfolk was used to imprison captured Confederate blockade runners.

However, in collaboration with the Army Corps of Engineers, the Norfolk Historical Society began making restorations and giving tours of the fort in 1991.