Yorozu was born in what is now part of Hanamaki, Iwate Prefecture in the Tōhoku region of northern Japan as the eldest son of a merchant.

In 1903, he traveled to Tokyo with his cousin where he attended the Waseda Junior High School, and briefly studied Zen meditation.

From 1914-1916 Yorozu returned to Iwate Prefecture to apply himself to his paintings, supported largely by the earnings of his wife.

At the 4th Nika Exhibition held in 1917, he displayed "Leaning Woman" and "Still-life with a Brush Stand", which provoked wide critical acclaim.

In 1923 he established the Enchokai together with Kobayashi Tokusaburo, Maeda Kanji, Hayashi Takeshi and Onchi Kashiro.