Nominally subordinate to the Governor of New South Wales from the early 19th century until the beginning of full self-government in 1856, he was effectively a government record-keeper and the officer with responsibility for the general administration of the colony.

However, for most of its history the Chief Secretary was in charge of all matters relating to correspondence with government departments, naturalisation, the Great Seal, state security, censorship and classification laws, the arts (to 1975), Public Health (to 1934), Aboriginal welfare (to 1969), Lord Howe Island, and environmental protection and fisheries.

"[3][4] On 30 June 1820 Major Frederick Goulburn was commissioned as Colonial Secretary and Registrar of the Records of New South Wales, being sworn in on 1 January 1821.

[2] The role was initially an administrative role, serving as primary record-keeper and revenue collector, but also being responsible for ensuring the effective operation of government departments, for the Governor's Council and on the Legislative Council, of which they were an ex officio member.

[5] The correspondence of the Colonial Secretary has become one of the most valuable sources of information on all aspects of the history of New South Wales and the early British settlement of Australia.