When news reached them in 1888 while they were travelling that the Duke's wife Anne had died, they chose to marry in Dunedin, Florida.
His children and Queen Victoria were infuriated, resulting in bitter and strained relations with them for the rest of their lives.
After marriage, Mary Caroline became the Duchess of Sutherland and obtained a high rank in British society.
However, the scandal surrounding their extra-marital affair and the swift marriage resulted in her being ostracized by high society.
Knowing and resenting this, the Duke wrote his will to leave a large portion of his estate to Mary Caroline as he was concerned that she would be looked after and be financially stable when he died.
The house was lavishly furnished, and Mary Caroline bought paintings and sculptures, including Andromeda by Pasquale Romanelli.
In accordance with a clause in the will of her second husband, the Duke of Sutherland, the Dowager Duchess Mary Caroline, was buried alongside him at Trentham Mausoleum.