He is the ancestor of the Stewarts of Ardvorlich on Lochearnside, whose family history is recounted by Sir Walter Scott in A Legend of Montrose.

[4] Alexander Campbell, writing in 1812, tells the following story: It happened that a party of Argyleshire Campbells made an excursion to the King's forests of Glenartney and Glensinglais, whereof he [Stewart] was the keeper, and killed a great many of the deer and roebucks, without so much as asking the permission of Little James.

The Argyleshire hunters, weary with the chase, and returning in quest of some habitation...met little James nearly opposite the small island on which his hut was situated, and inquiring of him what Magpie had built his nest on that island, he answered, 'One that hath scorned all manner of greedy hawks, from whatever quarter they might chance to come'.

In due time the Campbells kept their word; and Little James, having gathered his people from the various glens over which his influence extended, gave the meeting to the Argyleshire party in so warm a manner, that few returned to give an account of the hawking match for which they so merrily departed.

Loch Achray is well known for its sheltered location, giving rise to placid waters offering magnificent reflections of the woodland to the south, the mountains and forests to the north and the majestic crags of Ben Venue to the west.