He was the son of Pär Aron Borg, pioneer of deaf schooling in Sweden.

Borg was born 6 August 1812 in Hedvig Eleonora Parish, Stockholm, Sweden, to Pär Aron Borg, three years after his father founded Allmänna institutet för döva och blinda å Manilla (Manillaskolan), the first school for the deaf in Sweden.

[3] Borg would subsequently devote his entire life to the further expansion and development of the institute.

[4][5][3] On 31 August 1848, Borg married his cousin, Anna Sofia Karolina Sadelin.

[6][7] He retired in 1875,[2] but continued to assist at the teacher training college he had founded in Manilla and teaching private lessons in sign language.