Some sources state that the house was built in about 1680 but the manorial rolls that record of sale of the plot of land on which it stands during the late 17th century do not mention a building until 2 May 1717 when they record the sale of land and "brick messuage etc.

[1] After his death in 1725, Carlton's nephew, Charles Douglas, 3rd Duke of Queensberry inherited the house and, with his wife, Catherine "Kitty" Hyde, the couple played host to literary and artistic figures of the time including John Gay who is reputed to have written and rehearsed the Beggar's Opera in 1728 whilst at the riverside summerhouse in the grounds.

Their children having predeceased them, the house passed to their niece, Lady Jane Scott, following the death of the Duchess in 1777 and Duke in 1778.

The house then passed in 1817 to their daughter, Lady Caroline Lucy and her husband Vice Admiral Sir George Scott.

[4][5] The Federal Republic of Germany bought Douglas House and grounds in 1969 and built a school around it.