On November 10, 1812, the Fort Frederick battery took part in the Battle of Kingston Harbour, repulsing an American naval squadron under Commodore Isaac Chauncey.

[4] Four stone Martello towers were built to strengthen Kingston's defences in 1846 during the Oregon boundary dispute between the United States and Britain.

The towers were meant to protect the shipyard and the entrances to the Rideau Canal and St. Lawrence River, from possible United States aggression.

Alexander Mackenzie was a foreman on the construction of the Fort Frederick Martello Tower and later went on to become Canada's second prime minister.

While on an unannounced trip to Fort Frederick to look for a possible site for a new military college, Prime Minister Mackenzie asked the then commandant, Colonel de la C.T.