Son of a governor of the state of Honduras in the Federal Republic of Central America, José Justo de la Milla y Pineda and Mrs. Mercedes Vidaurre Molina, the daughter of a wealthy Guatemalan family.

He was married to his cousin, Mercedes Vidaurre and had 7 daughters and sons.

Milla grew up in a time of great instability, where the struggles between liberals and conservatives were bringing chaos to Guatemala.

His main theme was life in the colonial Guatemala.

Jose Milla was well-educated, an expert of Guatemalan idiosyncrasies, its history and its customs.