[1] He was born on 16 May 1921 in the (now-abandoned) village of Kjelvik in Nordkapp Municipality in Finnmark county, Norway.
He was the son of bailiff Carl Henrik Arneberg With and wife Aagot (née Scherffenberg), both of whom died in the 1950s.
He was the father of Christian Democratic politician Odd Anders With, and grandfather of 2006 Pop Idol victor Aleksander Denstad With.
He served as a deputy representative to the Norwegian Parliament from Nordland county during the terms 1961–1965 and 1969–1973.
He was a member of the board of the Christian newspaper Vårt Land from 1964 to 1984 and of the MF Norwegian School of Theology from 1969 to 1977.