A National Parks hut located near the centre of the island houses a small rotating group of around four people for much of the year.
The vegetation of Phillip Island was devastated due to the introduction, during Norfolk's penal colony era, of pest animals such as pigs, goats and rabbits.
This caused massive erosion, giving the island a reddish-brown colour as viewed from Norfolk, due to the absence of topsoil.
Since then, natural regeneration of native species and weeds, and remediation work by park staff, has brought considerable improvement to Phillip Island's environment.
Abutilon julianae was rediscovered on Phillip Island when the rabbits had almost been eradicated; it had been believed extinct for more than seventy years.
Despite the environmental degradation, the lack of feral cats and rats on the island has allowed some animals to persist there after having become extinct on Norfolk.