In the 13th century the manor of Hastoe was conveyed to Ralph le Clerk of Tring by Thomas de Northwode.

Nathan's son, Lionel de Rothschild like most of the family was said to be obsessed with hunting and set up his own kennels at Hastoe in 1838.

Subsequently, Hastoe being as part of the Tring estate, came into the hands of Lionel de Rothschild acquiring it at auction in 1872.

Also built by the family were a chapel, which continued to serve a congregation until 1962, a corn mill, which burned down in 1964, and a distinctive Village Hall known as the Hastoe Room frequented by the Working Man's Club.

Annie Patricia Llewellyn-Davies (1915–1997) his wife and Labour Party politician, became Baroness Llewelyn-Davies of Hastoe, on 29 August 1967.