[2] After leaving Celtic, Kavanagh had spells with several clubs before finishing his career with a works team prior to the Second World War.
Bohs manager, an ex-Rangers player, Bobby Parker, put the teenage Kavanagh straight into the first team.
In April 1929 Kavanagh signed for Celtic and made his Scottish League debut in 2–1 win over Hearts on 10 August 1929.
Despite an initial bright start at Celtic, following a serious knee injury Kavanagh subsequently lost his first team place and was released by the club in May 1932.
On 26 April 1931 he helped an FAI XI that also included Tom Farquharson, Paddy Moore, Jeremiah Robinson, Harry Chatton and Charlie Dowdall gain a respectable 1–1 draw at the Montjuic Stadium in Barcelona.