[4] Atkins was named in the matchday squad for the first time as an unused substitute in Derby's 2–1 win over Coventry in November 2009.

Atkins made his first team debut and kept a clean sheet for the Harriers in a 3–0 win over Histon and made 13 appearances for the Harriers, playing in both FA Trophy Semi-finals matches against Stevenage Borough, before an injury to first choice Derby keeper Stephen Bywater saw him recalled to act as cover for Saul Deeney for the remaining two games of the season.

[6] On 10 August 2010, Atkins agreed to join Conference National side Tamworth on a month's loan,[7] which was later extended until January 2011.

[9] Following the loan signing for Frank Fielding and the recall of James Severn from Tamworth, Atkins was once again sent on loan to the Conference National side, this time until the end of the season[10] However, in February 2011, Derby were again compromised by fresh injuries to both Stephen Bywater and Saul Deeney and Atkins was again recalled from Tamworth.

[11] He mainly played the role of understudy to loan goalkeepers Frank Fielding & Brad Jones, but after some sub-par performances from Jones and criticism by Clough in a 2–0 defeat against Bristol City[12] Clough hinted that he had considered starting Atkins in the game and stated that he was under consideration to start against Reading, the final game of the season.

[24] During the 2012–13 post season, it was reported by the Derby Telegraph that Atkins was close to joining fellow Derbyshire club Alfreton Town on loan.

[27] Derby decided to bring Atkins back on 3 January 2014 by activating a recall clause in his season-long loan.