[1] He was named after his maternal grandmother Harriet Elizabeth (Bayard) Van Rensselaer.

Bayard city homes were a part of the Thayer Family land.

[3] He built the Thayer estate in Lancaster, Massachusetts, in 1901 and designed by architect Guy Lowell and landscape by Herbert W.C.

[4][5] It was built as a summer home to Thayer who was a horticulturalist, the mansion then passed through the hands of the Greek Orthodox and Catholic churches, was briefly a school for the blind, and ultimately became the famed Maharishi Ayurveda Health Center used by celebrities such as Elizabeth Taylor.It still stands today in Lancaster, and is presently unoccupied and up for sale.

Morgan's steel hull schooner Constellation in 1892, and having the George Stewart designed the yacht Pilgrim built for him.