[2] In 1864 Tooth sold Cranbrook to Robert Towns who was a successful Sydney merchant, shipping company owner, the founder of the city of Townsville, Queensland and a Member of the New South Wales Legislative Council.

[4] In 1873 he bought Cranbrook and employed John Horbury Hunt, a prominent architect, to carry out large extensions on this property.

He then moved in with his wife Emily and brought into his house expensive art treasures including pictures by Italian German and English painters.

One of White's main interests was horseracing and shortly after he bought Cranbrook he also purchased Kirkham near Camden where he developed his horse stud.

It appears that this was originally on White's land and was owned by him because when Cranbrook was put on the market in 1898 the advertisement stated that there were two lots to be sold.

A publication made the following comments about the grounds:[5] "The terrace in front which shuts out the high road is a very happy arrangement, and thanks to the well-stocked glass and bush houses a continuous supply of flowering plants is maintained.

Goldfinch and Pylades.."Their stay in Cranbrook was short, as by 10 March 1900 Lovely sold up all household goods in "consequence to his departure to Europe".

Omrah,[12] she returned to Australia and set up home in Randwick where their daughter, Gwendolyne Harvey Lovely, was born on 22 November 1900 and later died 5 months on 16 April 1901.

In October 1906 the Government attempted to extend the lease but Captain Scott was unwilling, preferring to sell or subdivide the property.

Eventually Captain Scott agreed to extend the lease for one further year but at much higher rent, after which the Government purchased the property for £22,500.

His wife, Lady Florence Rawson, died during this time in 1905 and his daughter Alice resumed her mother's duties as hostess at official functions.

One publication described it in detail as follows:[26] "Friday last was the most perfect day we have had this season and the world and his wife took advantage of the sunshine to visit Cranbrook, Rose Bay, to assist in making a success of the fete in aid of the District Nursing Association.

Upon the asphalt tennis court small tables for afternoon tea were set, each table enhanced by the addition of its vase of flowers and the whole was presided over by a bevy of pretty girls in white frocks and black picture hats their distinguishing colours being huge bows of pale blue satin ribbons placed on the corsage.

Down the hill towards the Rose Bay Road some dozen marquees were erected and these were furnished with gaily-draped stalls laden with the most attractive articles tempting to the would-be purchaser.

Some of it is outlined as follows:[27] "The late rain had made everything look so beautifully fresh and green that seldom if ever have the picturesque grounds of Cranbrook been seen to greater advantage.

The water was so calm that it looked like a huge sheet of glass with the stately American ships lying quietly at anchor, most of them being within view from the lawn.

His Excellency and Miss Rawson received their guests on the verandah where each visitor was announced by Captain Wilson A.D.C, Mr Miller being also in attendance.

On the upper lawn refreshment were served in a large marquee, the top of which was draped inside with pale blue and white (his Excellency's colours), and a band stationed on the verandah played a bright selection of music including many familiar American airs.

[30] The New South Wales Government rejected any longer lease, despite not appearing to have any immediate intentions to proceed with the development of the library or museum.