His architect was Edward Welby Pugin, who "encased and incorporated"[5] the earlier manor house dating from 1614 into a larger structure.
The house is now the property of the 10th Baron's great-grandson Edward Fitzalan-Howard, 18th Duke of Norfolk, 13th Baron Beaumont (born 1956) of Arundel Castle in Sussex, who has allowed it to become the home of his younger brother, Lord Gerald Fitzalan-Howard (born 1962).
Carlton passed to Nicholas's nephew Sir Bryan Stapleton (c.1321–1394), a Knight of the Garter and Warden of Calais, younger brother and heir of Sir Miles Stapleton (c.1320–1372), of Bedale, Yorkshire, a founder Knight of the Garter.
The house was re-built to its present form in 1873-5 by his son Henry Stapleton, 9th Baron Beaumont (1848–1892), an officer in the British Army, who married Violet Marie Louise Wootton Isaacson, daughter of Frederick Wootton Isaacson.
As he had no children his heir was his younger brother Miles Stapleton, 10th Baron Beaumont (1850–1895), an officer in the British Army, who married Mary Ethel Tempest, daughter and heiress of Sir Charles Henry Tempest, 1st Baronet (1834–1894) of Heaton,[12] Bolton le Moors, Lancashire.