[5][citation needed] In 1971, Kaumba joined an amateur team called UBZ which was sponsored by the United Bus Company of Zambia.

[9][citation needed] Nicknamed '’Abaleya'’ – a popular call by Copperbelt mini-bus conductors to lure customers which means 'those who are going'.

[11] In 1983, Kaumba successfully attended trials with French second division side AS Cannes, but while contract negotiations were going on, his agent told him of another offer in Ivory Coast and advised him to sign.

In August, Kaumba suffered knee ligament damage in an Independence Cup semi-final against Kabwe Warriors at Kafubu Stadium in Luanshya which forced him to retire from football.

Kaumba was called up to the Zambia national team by Brian Tiler, and scored a last-minute goal in a CAN qualifier against Malawi on 15 April 1979 in Blantyre, leading to a 2–0 victory.

A month before the Moscow Olympic Games, he suffered an injury in a friendly match against Zimbabwe in Lusaka which made him miss the tournament.

[citation needed] Later that year, Kaumba struck twice when Zambia beat Egypt 5–3 in Cairo to win the CAF Silver Jubilee tournament.

He scored against Egypt again in an Olympic Games qualifier in Lusaka on 9 October 1983 in a 1–0 win with a late goal off Chola's free-kick although Zambia lost the return leg 2–0 in Cairo.

When Kaumba's career ended, he concentrated on working for ZCCM Power Division in the Accounts Section until he was appointed assistant coach to Alex Chola at Dynamos in 1988, a position he held until 1989 when he was given the task of heading youth football at the club.

[14] It also began a slide and by September, the team was in eighth position on the table with only one win in 9 league matches, prompting the dismissal of the man who had done away with Kaumba's services, Lt.

[15] In May 2002, he resigned from Buffaloes barely 6 weeks into the new season, in an apparent response to pressure from fans, who harassed him after his team lost to lowly Zamsure in Lusaka.

[16] Kaumba also doubled as coach of the U-23 national team and took them to the semi-finals of the 2003 All Africa Games in Abuja, Nigeria, with a squad that included Christopher Katongo, Kennedy Mweene, Stophira Sunzu, Kalililo Kakonje, Isaac Chansa and Collins Mbesuma.

[17] When United dropped to Division II in 2006, Kaumba moved to newly promoted Zamtel the following year, but after six points won from 11 games, his contract was terminated, with the team at the bottom of the log.

[17] When NAPSA Stars won promotion to the FAZ Premier League in 2011, Kaumba joined them as assistant coach to Patrick Phiri.

In October 2012, Phiri was sidelined and he took over the reins as acting coach, and won the Barclays Cup 4–2 in a penalty shootout after poor defending by both teams culminated in a 4–4 draw at full-time.