In 1901 or 1902, he left for a supposed solo yacht trip around the world but instead ended up sailing up a tidal tributary of Te Wai-o-Pareira / Henderson Creek, on New Zealand's North Island, where he lived inside his yacht for at least 25 years until his death.

[3][4] Swan's father's profession is not recorded but it is believed he was a wealthy individual, possibly a large shareholder in the "London and Great Eastern Railway Company" (presumably the Great Eastern Railway).

[3] Swan married his wife, Edith Mary Widdrington, in Ontario, Canada, at age 25.

[4] Before leaving for New Zealand, Swan had established an orchard in Northumberland following an interest in botany.

[3][8] Swan and his wife lived in Devonport, and in either 1901 or 1902 he sailed out onto the harbour aboard the Awatea, the yacht he had purchased in 1900.

[8] Despite reports of Swan being a complete recluse and being 'discovered' in 1910 after years of isolation there is evidence this is either untrue or a heavily distorted story.

[15] Lucy Cranwell-Smith, a highly regarded botanist, credits Swan with helping foster her interest and learning about botany.

[9] Maurice Shadbolt's novella, Dove on the Waters, is inspired by Swan's life.

[8] Swan built tunnels to store his crops and books using bricks that had fallen off the pottery ships in the side of the creek.

After the construction of Central Park Drive in the 1980s the arch and creek was discovered after being largely forgotten.

[9] Roughly 1 metre (3 ft 3 in) of the arch is now no longer visible because of a build up of dirt.

The entrance to the vault boasts two Tuscan pilasters that have a parapet with capitals slightly above.

[4] The cellar vault, likely built as a library, has decayed and partially collapsed over the years.