The mansion was built on the same site as "Waldorf", John Jacob Astor III’s (1822–1890) somewhat less grand Renaissance-style residence that was razed.

In 1933, Bingham donated the 484-acre estate to the Episcopal Diocese of New York, which established the Wiltwyck School for Boys, serving troubled children from 1937 until 1966.

[5] In 2009, after the death of Rich, it was revealed that he had bequeathed the estate to Marist College, located on the east bank of the Hudson River in Poughkeepsie, New York.

[6] The 1909 mansion, completed in 1911, is constructed of reinforced concrete and faced with Italian limestone topped by red tile clad hipped roofs.

The eastern portico has six single-story Ionic columns set between rugged arched pavilions and is fronted by a balustraded terrace overlooking the river.

[4] The estate is considered one of the most architecturally significant houses in the Hudson Valley,[3] and it was listed on the National Register of Historic Places in 2002.