Jensen was born in Nakskov, Denmark, but spent much of his childhood in northern Sweden, because his father obtained a job there as the manager of an estate.
Their family returned to Denmark before 1876, when Jensen enrolled to the College of Advanced Technology.
Although he studied mathematics among various subjects at college, and even published a research paper in mathematics, he learned advanced maths topics later by himself and never held any academic position.
Instead, he was a successful engineer for the Copenhagen Telephone Company between 1881 and 1924, and became head of the technical department in 1890.
All his mathematics research was carried out in his spare time.