[1] It was created on 1 July 1826 for Charles Ellis, a Jamaican sugar planter and slave-owner who had earlier represented Heytesbury, Seaford and East Grinstead in the House of Commons.
Charles married in 1828 Lady Lucy Cavendish-Bentinck, daughter of William Bentinck, 4th Duke of Portland, and his wife Henrietta Scott.
[2] His grandson, the eighth and fourth Baron, assumed in 1917 by Royal Licence his great-grandmother's surname of Scott in addition to that of Ellis.
Lord Seaford is also high in line of succession to the barony of Howard de Walden.
However, by Royal Warrant dated 25 June 2004, the Queen called the Barony of Howard de Walden out of abeyance in favour of the eldest daughter, Mary Hazel Caridwen Czernin (born 1935).