He was appointed Librarian at the public library in Doncaster, Yorkshire in 1880 despite his young age.
Here he built his reputation and began writing a column, "About books", in the local newspaper, The Doncaster Chronicle.
Sir John Williams had promised a donation to the new library, and it was he who offered Ballinger the post of librarian, without competition.
He retired on 31 May 1930 and was thanked by the Court of Governors for:[1] devoting all your energies to the formation and administration of a national institution which, from comparatively small beginnings, has now become one of the great libraries of the world ... due in no small measure to your abundant energy, driving power, capacity for taking pains, and ability not only to discover, but also to secure valuable collections for the Library.Of his many achievements, there were special mentions for securing the National Library's status as a legal deposit, and gaining "the continued interest and support of the general public".
[1] He retired to Hawarden, Flintshire, there, he offered advice to St Deiniol's Library and resumed his publishing career and his commitment to the historical bibliography of Wales.