[1] He was the only son of Mehitable (Jacobs), a dressmaker and Holdridge Primus, a grocery store clerk at R.S and G. Seyms Co.
[4] Gad Asher, Holdridge's maternal grandfather, gained his freedom from slavery through his service in the American Revolutionary War.
[7] In the spring of 1865, the family moved to Boston so that Primus could study art and find work as an artist.
He first studied art with Edward Mitchell Bannister, a prominent African-American portrait painter and landscape artist.
His parents were supportive of Primus' aspirations and helped the family financially, often sending gifts of money or food.
[7] In 1895, Primus and his wife Mary moved to the west coast, initially living in Seattle for a few years.