In 1889, former British Columbia premier Amor De Cosmos was the first person who is known to have suggested Swartz Bay publicly as a feasible ferry terminal for connections to the Lower Mainland.

It destroyed part of the passenger walkway and a wingwall, prior to being contained by terminal staff, firefighters and the approaching Queen of Nanaimo, which utilized its hoses to help keep the blaze at bay.

[6] On September 14, 2000, the ferry Spirit of Vancouver Island struck a pleasure craft just off Swartz Bay, killing two individuals.

[7] On May 20, 2011, a truck waiting in line drove up the upper ramp of the terminal's first berth and then through several guard barriers and safety netting at an increased speed.

The terminal includes an administration building, and various kiosks run by local artisans and other vendors mainly in the warmer months.

Swartz Bay is the only major southern terminal in the BC Ferries system without a traffic signal at its entrance or exit.