The house and estate are listed in the New South Wales Heritage Database as a site of local historical significance.

In 1829 George commissioned the famous architect, John Verge, to build Toxteth House on 39 hectares (96 acres) that he had acquired in Glebe.

[5] George had a particular interest in horticulture and the grounds surrounding the house contained many different varieties of trees and flowers.

In 1845 he entered the Horticultural Show and displayed flowers which included amaranthus, celosia, fuchsia, salvia and amaryllis.

As well as being a lawyer he was Mayor of Glebe for some time and later entered the NSW Legislative Assembly and became Minister of Justice and Public Instruction.

The substantial home on the estate included a large library that housed a huge collection of books amassed by Allen.

[8] When George's father died in 1877 he inherited Toxteth Park but did not move to the property until 1881 because he wanted major alterations made to the building.

[9] From the early 1880s some of the land around Toxteth Park was sold by George and free standing villas were erected.

[10] Lady Allen remained at Toxteth house after her husband's death until about 1900 and then moved to Banksia in Woollahra.

However, in 1899 the Government decided to build Central Railway Station and several properties including the school owned by the Good Samaritan Sisters were resumed and demolished.