The main two-storey chert stone building is accompanied by various outbuildings including barns and a mill.

The Gerbestone estate was created around 1235, when a local knight "Gerebert" was granted an exemption from paying taxes by Bishop Jocelin of Wells.

[5] In 1612 the owner was Thomas Frances, who married Suzanna, daughter of George Luttrell of Dunster Castle and later it was owned by John Ewell.

[5] In 1693 the house was mortgaged by Nicholas Frauncies and then sold to Sir John Elwell whose descendants lived there until 1894 when it was bought by William Temlett Marke.

[5] Further restoration was undertaken in the 1920s and 1930s by Hubert Lidbetter, for the Lloyd-Fox family who were the owners at the time,[1] which included a new staircase and windows and the removal of all the plaster on walls and ceilings.