In January 1876, he was graciously permitted by Her Majesty's Government to enter the Colonial Office at Downing Street and worked until 1878, when he was appointed as cadet in the Straits Settlements Civil Service.

Sir Ernest previous experience in the Colonial Office enabled him to be of special assistance of all important Commission on the Police Force held about 1880.

He was also the District Officer at Alor Gajah and Jasin, in spite of many opposition, he succeeded, by means of acquiring an intimate knowledge of the people, in establishing new system, and the revenue was greatly enhanced during his four years' stay in the territory.

During his office as the Acting British Resident of Perak, he called the first meeting of the State Council, over which he presided, for 2 November 1895 the twentieth anniversary of his father's murder.

He arranged the agreement, by which the Yang di-Pertuan of Sri Menanti, who had long been estranged from other chiefs, was recognised by them as the constitutional head of Negeri Sembilan.

During his short administration, Negeri Sembilan's revenue grew from $552,000 to $1,085,000 and a new land and survey system was introduced and public service was greatly improved.

He travelled over the whole territory in North Borneo, and introduced numerous settlers, built a new town at Jesselton and converted the country from lawlessness to peace.

He also served as Chairman of the Eastern Smelting Company Limited, founded by Chung Thye Phin, Eu Tong Seng and others.