He was educated at St. Paul's School under Alexander Gill, and went up with his class-fellow John Milton to Christ's College, Cambridge, where he was admitted a lesser pensioner 28 February 1625.
On 20 September 1640 Pory was collated to the rectory of St. Margaret's, New Fish Street, London (which he resigned before 18 August 1660), and in November following to that of Thorley, Hertfordshire.
On the outbreak of the First English Civil War he was, according to Richard Newcourt;[2] "plundered and sequestred"; but his name does not appear in John Walker's Sufferings of the Clergy.
On 20 July 1660 he was collated both to the rectory of St. Botolph, Bishopsgate, London (resigned before 22 May 1663), and to the archdeaconry of Middlesex.
On 16 October (but, according to John Le Neve, 16 August) 1660 he was installed prebendary of Willesden, in the diocese of London, and before the year was out was made chaplain to Archbishop William Juxon.
Pory was licensed, 21 September 1640, to marry Elizabeth, daughter of Thomas Juxon of Chichester, a relative of the archbishop.