It was built from 1912 to 1914 for Fred Loring Seely, the son-in-law of Edwin Wiley Grove.

He built the castle after his father-in-law gave him ten acres on top of Sunset Mountain.

The limited area for developing new buildings caused the trustees to move the college to its current site on the northern edge of Asheville.

He upgraded the heating system from coal to oil fuel and put a new roof on the structure.

[3] The castle has two large glass windows that offer a panoramic view of Asheville.