John Betjeman, who for a time was in love with her, referred to her in his unpublished poem, "The Mitford Girls", as the "most rural of them all" since she preferred to live quietly in the country.

They met when she was managing Biddesden, in Wiltshire, the house of her brother-in-law, Bryan Guinness, 2nd Baron Moyne.

They lived at Tullamaine Castle in Fethard, County Tipperary, with Jackson's bisexuality and womanizing raising some suspicions that it was a marriage of convenience.

[4] After her divorce in 1951, she spent much of the next twenty years as the companion of Giuditta Tommasi (died 1993), an Italian horsewoman.

Jessica Mitford described her as having become a "you-know-what-bian", although Diana was less certain whether Pamela and Giuditta were lovers.