Chong was born in Sarikei in the then-British protectorate state of Raj of Sarawak to a couple who were owners of a Chinese drugstore.

[1][2][3] After his father had fallen ill, Chong returned home to take over the helm at the family business after having only completed Form 3 (Year 10) of his high school.

[1][2] On 27 September 1962, Chong, aged 27, used his savings from his teaching days to pay for his ship ticket to London, United Kingdom to begin his studies after being accepted into Lincoln's Inn.

For the following 14 years, he would serve in this capacity at various cities around the country where the High Courts were found, including Kuching, Kota Kinabalu and Sibu.

He was married to Puan Sri Datin Amar Rosalind T'en Yaw Hee on 2 October 1968, together, they have one son and three daughters.