During the presidency of fellow Ohioan William Howard Taft, Ellis held several positions within the U.S.Department of Justice until resigning in 1911 shortly after the U.S. Supreme Court decided to break up Standard Oil, a case in whose investigation he had assisted indirectly.

He drew considerable criticism in the 1910 election for holding the federal job as well as that of chairman of the Republican campaign in Ohio, which caused him to promise to resign, although he continued as special counsel with the Justice Department for several more months.

[5] Always interested in history, Ellis visited northern Virginia estates, including Mount Vernon and Gunston Hall while he lived in Washington, D.C.

He found Rippon Lodge in disrepair, bought it and made extensive alterations which transformed the structure into the Colonial Revival style.

His wife also oversaw revitalization of the grounds, which not only resulted in favorable publicity, but also made the estate a gathering place for meetings of the Daughters of the American Revolution, Garden Club of Virginia and benefit events for organizations including the Association for the Preservation of Virginia Antiquities, Archeological Society of Washington and a fraternity from George Washington University.

Ellis died at his home on Massachusetts Avenue in Washington D.C.[6] Chief Justice Fred Vinson was one of the pallbearers at his funeral at the National City Christian Church.

[1] His widow decided to put Rippon Lodge for sale, in part after contact with Richard Blackburn Black, the grandson of Louise D.F.