Built in the mid-19th century, the property was designated a National Historic Landmark for the role it played in the celebrated case of the Amistad Africans, and as a "station" on the Underground Railroad.

When the Mende men who had participated in the revolt on the slave ship La Amistad were released from prison in 1841, Williams purchased this property and erected a dormitory building in which the Mende men could stay while awaiting arrangements for their return to Africa.

[1] Williams was friends with Lewis Tappan who was assisting the Africans.

The cellar of the carriage house served as a hiding place for escaping slaves as a part of the Underground Railroad.

The house is a private residence and is not open to the public.