His father served as an officer in the British Army in North America and after retirement, in 1832 brought his family to New Norfolk, Tasmania near to the penal colony of Hobart.
James, his mother and three of his siblings remained in Tasmania until November 1837 when the family moved to Sydney, Australia.
He leased and then freeholded land under "The Settled Land Act" in what is now Toohey Forest Park, Mount Gravatt Cemetery, Queen Elizabeth Sports and Athletics Centre and Griffith University, and ultimately held possession of the Toohey Forest area.
His will protected land comprising the Toohey Forest area from being sold off after his death within his children's and wife's lifetime.
[9] Toohey Forest Park and the Mt Gravatt Cemetery reflect the family's history within the region.