Two manors on the site are first mentioned in 1436, held by Baron Johann Dürrer (von der Dur) concurrently with the Counts of Celje, and later sold to the latter.
The Counts of Celje were followed by several other owners, including Baron Johann Baptist von Valvasor in 1581, the Counts of Moscon, the House of Auersperg from 1653 to 1903, Baron von Gagern, and a Dr. Trenz.
Leskovec Castle is a typical example of centrally-based defensive architecture with corner towers and a rectangular, arcaded inner courtyard in the middle.
The four residential wings enclose the most significant architectural feature of the building, a beautiful arcaded courtyard.
Leskovec Castle and the surrounding grounds were declared a cultural monument of national importance by the government of Slovenia in 1999.