[2] It was known that the area surrounding Burtersett was a Royal Forest during the reign of Edward I, but gradually the local industry gave way to sheep farming, then later quarrying and dairy produce.

[5] The candle factory, a four-story building, still exists today, but the operation is believed to have stopped in the early 20th century.

Although the men referred to themselves as quarrymen, both sites were actually mines which operated 2-foot-3-inch (0.69 m) gauge tramways to transport the stone into the village.

[3][13] The house was the birthplace of many in the Hillary family, including Sir Henry (1697–1763), who was known for his work on tropical diseases.

[14] His nephew, Sir William Hillary, who campaigned for the institution of the RNLI, was born in the village.