The Jesuit Bautscher, a contemporary of Valvasor, left a message in Latin, which placed St. Hemma, among other goods, also brought the Grailach rule into the marriage: "[...] dotem attulit comitatum Peilnstein, castra Vizel, Landsberg, Weitenstein, Andernacum, Nassenfues, Grailach, Erkhenstein, ac alia praedia in Carniola sita [...].

Its estate was later granted to Count William II, Breže-Selško, and after his death his wife Hemma of Gurk donated the property to the Krško diocese.

The court was first written about indirectly in 1163, when a document mentions the knight of Škrljevo and the minister of Aquileia, Majnhard Škrljevski (purchrauiis Megnardo de Crilog).

In 1541, Škrljevo Castle came into the possession of the Auerspergs and in 1585 a document appeared which named Janez Baltazar Wernegk as the owner.

In the forest west of Škrljevo Castle, tumulus from the Early Iron Age with diameters of 15 m and 12 m and heights of 2 m and 1.5 m were discovered.