He was the son of Louis I, Count Palatine of Zweibrücken and Johanna of Croÿ.
His father, Louis I, was afraid that after his death his dominions would be divided between his sons, with Kaspar receiving the County of Veldenz and his brother Alexander the Cripple receiving the Duchy of Zweibrücken.
Kaspar was declared mentally ill and incarcerated in Veldenz Castle.
It cannot be determined conclusively whether Kaspar actually suffered mental or moral issues relevant to his duties as Duke, or whether he was moved out of the way by a power-hungry younger brother.
Louis' decision that the brothers should jointly rule can be interpreted in different ways.