After being released he drifted into non-league football, firstly at Paget Rangers, where he won the Midland Combination under the guidance of manager Rhys Davies.
Allner then made his first entry into coaching, being appointed player assistant manager at Cheltenham Town.
Their most successful season came in 1994–95 when they reached the fifth round of the FA Cup, knocking out second-tier side Birmingham City (Allner's first club as a player), and Preston North End.
They also won the Conference title that season, but were denied promotion because their Aggborough ground was not deemed up to Football League standards.
Kidderminster almost made it to the Football League in 1996–97 after leading the Conference by 15 points at Christmas, but a storming run by close contenders Macclesfield Town pushed them into second place.