[1] He was born at Gosport, Hampshire, England, to Henry Edward Goldfinch, a lieutenant in the Royal Navy, and Elizabeth Maria, née King.

He arrived in New South Wales in 1886 and was educated at Sydney Grammar School before working for the Colonial Sugar Refining Company (CSRC) in 1902 as a chemist.

Goldfinch was appointed general manager of CSRC in 1928 and served until 1943; he was also chairman of the British Settlers' Welfare Committee from 1931.

[2] In 1930, Goldfinch chaired a series of secret meetings to convene the Old Guard, a right-wing paramilitary organisation organised in opposition to the policies of New South Wales Premier Jack Lang.

[3] In 1935, Goldfinch won a by-election for the New South Wales Legislative Assembly seat of Gordon, representing the United Australia Party, but he resigned in 1937, before the expiration of his term, citing business commitments.