[7] His father served one term on the Supreme Court of New York and was appointed a Provisional Judge in the District of New Orleans by President Abraham Lincoln.

[23] When asked for an autobiography at the time of his appointment, he replied: "I am a lawyer and have practiced in this city for about thirty years.

The story of my life is just like that of a hundred other lawyers who work all the time at their profession and take an occasional day off on which to play.

[27] Together, they lived at 224 Madison Avenue in New York and had a country place at Cold Spring Harbor on Long Island.

[26][34] After his wife's death, Peabody moved to 635 Park Avenue on Manhattan's Upper East Side, where he died on April 26, 1931.

After a funeral at the Church of the Resurrection at 119 East 74th Street, he was buried alongside his wife at Mount Auburn Cemetery in Cambridge, Massachusetts.

[1] Through his eldest son, he was a grandfather of Julian Livingston Peabody Jr. (1914–2014), a lawyer with LeBoeuf, Lamb, Leiby,[35] and Daphne Peabody, who married Edward Eugene Murray, a Dartmouth College graduate who was the son of the Democratic Senator from Montana, James E. Murray, in 1944.