His mother died when he was a young boy and for a time he Eliza lived and labored on an uncle's farm.

The couple moved to California, and had three sons, Homer Crary (1877-1907), Earl Merritt (1878-1884), and Seward Adams (1880-1964).

[2] Rickards was a salesman in the mercantile business, and also involved in real estate, insurance and the oil industry.

The Rickards then had five children: Howard Burris (1884-1952), Carlisle (1885-1958), "Baby" (1886), John Ezra (born and died in 1889), and Rachel (1891-1954).

[2] After his stint as governor, Rickards, his wife, and five surviving children aged 9–24 moved back to Butte, Silver Bow County, Montana.

[9] Rickards died of angina pectoris and chronic myocarditis at his Berkeley, Alameda County, California home on 26 December 1927.