[1] A fortification was constructed during the War of 1812 to protect the Kingston Royal Naval Dockyard (the site of the present-day Royal Military College of Canada) on Point Frederick from a possible American attack during the war and to monitor maritime traffic on the St. Lawrence River and Lake Ontario.

The garrison and the developing townsite near the fort were deemed difficult to defend and so Captain John Ross, the British officer in charge of settling Loyalist refugees in the area following the American Revolutionary War, proposed moving the stronghold along with the townsite to the more defensible Point Henry.

British-American hostilities still concerned the British, and the high promontory of Point Henry was considered to be a good location for a defensive fortification.

[2][page needed] On November 10, 1812, this battery was involved in repelling several American warships that were attacking the Provincial Marine sloop Royal George as the ship was taking refuge in Kingston Harbour.

By 1820 the fort consisted of earth and stone ramparts, demi-bastions, redans, ditches, magazines, barracks, signal towers and support batteries.

In 1843, the advanced battery overlooking the lake to the south was completed when the casemated commissariat stores and magazines were built.

A system of more elaborate defensive works was planned but cost overruns in the construction of the canal limited the fortifications to four Martello towers and the fort itself.

Canadian units who used the fort include "A" and "B' Batteries of Garrison Artillery, and the 14th Battalion, Princess of Wales' Own Rifles.

German, Austrian and Turkish prisoners of war and some civilians, including Ukrainian immigrants described as "enemy aliens" during Canada's first national internment operations of 1914–1920 were also held at the fort.

A Sunset Ceremony is held every Wednesday in July and August, where a full program of historic drill, music and artillery is presented.