He made some first-team appearances in 2009–10 but was otherwise limited to youth and reserve team football until he won a loan move to Port Vale in August 2011.
He scored for the Gers in the club's Scottish Youth Cup final victory over Old Firm rival's Celtic at Hampden Park in 2008.
He made his senior debut as a substitute for Kris Boyd in the 3–0 win over St Mirren in the Scottish Cup semi-finals on 25 April 2009.
[14] He made two starts and five substitute appearances for the League Two club, with his contribution at Vale Park also limited by call-ups to the Northern Ireland squad.
Instead, he signed a new contract with the club in July 2012, having decided to stay and try to help Rangers to win promotion out of the Third Division.
However, Little missed much of the campaign after breaking his cheekbone and jaw in a collision with Dunfermline Athletic full-back Alex Whittle in November.
[27][19] Little signed a two-year contract with League One side Preston North End in June 2014; "Lilywhites" manager Simon Grayson stated that "I am delighted that he has chosen us over quite a few other teams".
[30] On 24 March, he joined Accrington Stanley of League Two on loan until the end of the 2015–16 campaign; manager John Coleman said "Andy's suffered with injuries this year so this is a chance for him to get some football and get himself back on track".
[32] After several months out of football, Little signed for Scottish League Two club Stirling Albion on a short-term contract in February 2017.
[33] He was hospitalised on 11 April after an accidental clash of heads during training left him with a fractured skull and eye socket.
[40][19] Little won eleven caps for the Northern Ireland under-19s, scoring four goals, including one in the 2008 Milk Cup final victory over Chile.
Little made his debut for the senior team on 28 March 2009 in a 2010 World Cup qualifier against Poland; he replaced David Healy in the 90th minute of the match and Northern Ireland went on to win 3–2.