[13] On 18 April 2023, Baker and a group of around fifty Church of England priests celebrated a Eucharist at the High Altar of the Archbasilica of St John Lateran as part of a conference for Anglo-Catholic clergy.

[16] Auxiliary Bishop Emeritus Guerino Di Tora of the Diocese of Rome (Chapter Vicar of the Lateran Basilica) expressed "deep regret for what happened".

[17] Father Martin Browne OSB an official at the Dicastery for Promoting Christian Unity noted the apology, but said, “I also think that everyone acted in good faith and without any intent to cause offense or embarrassment to anyone else.

[20] From 2010 to 2014, Baker was the chairman of Forward in Faith, a traditionalist Anglo-Catholic membership organisation which supports and finances the work of The Society.

[21][22] The Society, which is governed by a Council of Bishops chaired by Baker, rejects the ordination of women to the priesthood and episcopate in the Church of England.

After twenty years membership, he left the organisation upon being appointed a bishop, stating that the criticism from some members of General Synod threatened to overshadow the inauguration of his episcopal ministry.

[26] In a letter dated 22 October 2014, Baker wrote to his clergy informing them that he had been given permission by Richard Chartres, Bishop of London, and Justin Welby, Archbishop of Canterbury, to remarry following divorce.