On either side of the cannons are two Washingtonia filifera (Petticoat Palms) planted by Queen Elizabeth II and Prince Philip, Duke of Edinburgh, in February 1975.

From the terrace opposite there used to be steps down into the garden; it was close to these that on the night of March 10, 1973, the then governor Sir Richard Sharples was murdered, together with his aide-de-camp, Captain Hugh Sayers, and his dog.

Down the steps there is an avenue of Bermuda cedars, the first on the left planted by Sir Edward Richards, the first black Bermudian to head the government of the Island.

On either side of the cutting leading to the entrance to the grounds are evergreen shrubs, and large bougainvillea vines over 100 years old cover the 30-foot (9.1 m) walls.

Back towards the terrace is a collection of Arecaceae (palms) planted by British prime ministers and US presidents: John Major (1991), George H. W. Bush (1990 and 1991), Margaret Thatcher (1990), Harold Macmillan (1961), Edward Heath (1972) and Richard Nixon (late 1960s).

[1] As the largest open green area in Pembroke Parish, it has every endemic and native species of vegetation that existed before the colonisation of Bermuda.

The grounds of Government House were severely damaged by Hurricane Fabian on September 5, 2004, and there is underway a long-term programme of clear-up, re-landscaping and planting.

In 2024 the building was deemed uninhabitable due to deterioration caused by water ingress and vacated pending major repair works.