Its position overlooks the whole of the Needles Passage and approaches to Yarmouth,[1] and is almost opposite Hurst Castle on the mainland.

The earliest fort on the site was Sharpenode Bulwark (also Sharpnode or Sharpnore) which was constructed in 1545–1547 as part of Henry VIII's coastal defences.

[3] It fell into disrepair and was repaired or even replaced in 1587 by George Carey, Captain of the Island.

[6] In the 1930s a proposal was made to run a car ferry between Fort Victoria and Keyhaven on the mainland.

[7] At the start of World War II the fort was used as a training battery for coastal gunners and it was equipped with torpedo tubes mounted on the pier.

[5] The rear barracks blocks were demolished in 1969 to provide material for sea defences and Isle of Wight Council purchased what remained of the fort soon afterwards.

[9] The fort houses a number of attractions including a Reptilarium, Visitor Centre and a model railway.