The Cleeves, or Cleaves Cove (Scots) cave system is situated in the lower beds of Carboniferous limestone.

A number of older books refer to the romantic sylvan dell of Auchenskeigh, now Auchenskeith, derived from Achadh-na-sgitheach - the field of thorns.

A number of old limestone quarries lie close to the modern day farm of Auchenskeith, but it is likely that Auchenskeigh is a synonym for Cleeves Cove.

[9] The cave system was formed in Dusk Glen when the waters of the Dusk (Dubh-Uisge, Gaelic for 'black water')[11] ran through and eroded the limestone, followed by a period when it was relatively dry allowing the stalactites and stalagmites to form and finally a progressive infilling with soil washed in from above, resulting in a partial infilling of the caves and passageways; at this point John Smith obtained permission from Captain Blair, R.N., of Blair House to explore and ultimately remove some 300 tons of material.

[14] Smith started in January 1883, working at night, with six volunteers, removing and sifting through 300 tons of deposits over a period of six months.

[16] During his excavations John Smith unearthed a number of man-made objects such as a flint knife, spindle-whorl, bone spoon, bronze finger-rings, a stag's horn handle, spear heads, parts of a bridle, an iron battle-axe and a cut-glass emerald.

Various bones were found, including those of beaver, sheep, hare, rabbit, cat, rat, dog, weasel, pheasant, partridge, duck, goat, ox, pig and goose.

Tradition has it that "A prediction was uttered many long ages ago, that Cleaves (sic), on three successive occasions, would be the first place in the parish visited by the pestilence.