It was formerly part of the fortified manor house of Affeton, built by the Stucley family in about 1434, and situated on the side of a valley of the Little Dart River.

[1] Affeton Castle formed part of a large fortified manor house built from grey rubble stone by the Stucley family in about 1434.

The manor house was almost entirely demolished in the English Civil War, the only part left standing was the gatehouse, which fell into ruin.

The ruinous gatehouse was converted in 1868–9 to a shooting box for the use of the Stucley family of Hartland Abbey and Moreton House, Bideford, and later became known as Affeton Castle.

[5] Sir Hugh Stucley, 6th Baronet (born 1945), lives in the castle in the 21st century, which is not open to the public, unlike the family's other larger residence at Hartland Abbey.