After the end of his playing career, he served as an umpire in first-class cricket.
1863 was the first year of first-class cricket, and Atkinson appeared for Yorkshire in 1861 and 1862.
He was run out for 4, batting at number 11, in England's innings but these runs proved vital as they enabled the United XI to take a first innings lead of 2.
The 22 Gentlemen were bowled out for 47 in their second innings, with none of the 22 batsman passing double figures, and Atkinson taking 8 for 22 in 30 overs, in an unchanged partnership with John Lilywhite, who took 11 for 25.
He umpired at least 26 first-class fixtures, the first the clash between Gentlemen of the North and Gentlemen of the South in August 1859, and the last of them the friendly match between Warwickshire and Gloucestershire at Edgbaston in August 1894.