It had 14 rooms on two storeys and had servants' quarters, a coach house and stables, but it was badly built – of brick, wood and stucco, with later extension of sandstone – and was demolished in 1858.

Designed by the Director of Public Works and colonial architect William Porden Kay, it is a fine example of an early Victorian country house in Gothic Revival style and is one of the largest of its type in Australia.

Sandstone was quarried on site (the excavated holes were made into ornamental pools), cedar and teak were recycled from an old ship, and slate for the roof was imported from Wales.

Outstanding exterior features of the house include bas-relief architectural sculptures, exceptional stonework, and individually carved sandstone chimney pots.

On 2 January 1858 Sir Henry Fox Young became the first governor to take up residence, moving to the capital from Government Cottage, Port Arthur, Tasmania.