Kapp would also win his second European championships in December that year, soon before the first ever official medal Olympics for curling in Nagano.

However, in 2005 Kapp was back, at the 2005 Ford World Men's Curling Championship, and won a bronze medal after play-off losses to Scotland's David Murdoch and Canada's Randy Ferbey.

In the semifinal against Ferbey, Uli shockingly playing the wrong turn altogether on his first shot in the final end, up 6-5 without hammer, leading to a disastrous miss and putting Germany in a near-impossible position for the remainder of the end and leading to their loss, with Ferbey scoring 3.

Two years later, at the 2007 Ford World Men's Curling Championship, Kapp skipped Germany to another silver medal, losing to Canada's Glenn Howard in the final 8-3.

The team returned to the 2008 World Men's Curling Championship without Andy's brother (and regular third) Uli, who was sidelined by season-ending knee surgery.