Whitehall is a former boom town, whose historical growth and decline has been linked to that of the herring industry, which was initially developed by the Dutch.

At its height, 300 boats were moored in Whitehall harbour, along with fifteen curing stations, and 1500 fish wives.

As a side effect, there were forty pubs here in the high season, and many houses took lodgers.

Aside from herring fishing and kelp burning, there was also a smaller industry in occasional whaling.

Fifty whales were once driven into nearby Mill Bay for oil, in a move similar to the Faroese grindadráp.