[1] Goulburn was appointed secretary and registrar of the records of New South Wales on 30 June 1820, very likely due to his brother's patronage.
He was doing useful work, but he could not escape the effects of the constant factional fights which also plagued previous governors.
Brisbane discovered that Goulburn had been withholding documents from him and answering some without reference to him.
In 1824 Brisbane reported his conduct to Lord Bathurst who was Secretary of State for War and the Colonies.
In reply, Bathurst recalled both Brisbane and Goulburn in dispatches dated 29 December 1824.