James IV first made him the teacher of his illegitimate son Alexander Stewart, and shortly afterwards his first secretary.
[1] Paniter held a papal dispensation for holding these church appointments while still not a priest, on account of his duties as royal secretary.
David Panter, secretary to Mary, Queen of Scots and John Lesley, Bishop of Ross, was his illegitimate son.
Carved panels bearing his family heraldry, originally from the Hospital, which were discovered in re-use in a private house in Montrose in the 19th century, are displayed in the National Museum of Scotland in Edinburgh.
[5] A nephew of Patrick, William Lamb adopted his uncle's surname and later wrote Ane Resonyng, a propaganda work addressing the issues of the war of the Rough Wooing.