[3][4] Kyle made 110 League and Scottish Cup appearances for the club and scored 52 goals during his four-season spell.

He was unable to claim any major honours in an era when rivals Celtic were dominant, the nearest being a runners-up medal from the 1904–05 Scottish Cup.

[5] He left Rangers 1908 to move to England with Blackburn Rovers and later Bradford Park Avenue before a brief stint in Ireland at Linfield.

Kyle returned to Scotland and played with Clyde, St Mirren[6] and Hamilton Academical.

In 1924, he and John Browning, a former Celtic player, were found guilty of attempting to bribe Bo'ness player Peter Brown in a public house in Glasgow's Dundas Street: both men were sentenced to 60 days' hard labour.