Throughout his university career, he was noted as an orator of distinction, and served as Auditor of the college's Literary and Debating Society for the 1862–63 session.

In January 1893, having left the office of Attorney-General, he called a motion at a Unionist meeting in County Fermanagh declaring renewed opposition to Home Rule.

At a meeting in March of that year (1893) at Leinster Hall Atkinson declared that a breach in the Union between the United Kingdom and Ireland would mean an end to civil and religious liberty.

His candidature was endorsed by Arthur Balfour, then leader of the House of Commons, with the words –"it is important that the loyalists of Ulster be represented by eloquent and able men".

As a former member of the cabinet he was seen as a political judge, however his industry and keen sense of justice came to be seen as a valuable addition to the bench.

A portrait by John St Helier Lander hangs in the Bar Room of King's Inns, Dublin.