Despite his qualities, Ole Madsen never played in the top-flight Danish championship, but stayed with local lower-league clubs.

[6] He was offered a contract by Spanish club FC Barcelona in 1964, but he turned it down in order to stay an amateur with the Denmark national team and HIK in the Danish 3rd Division.

[7] In 1965, Madsen signed a professional contract with Dutch team Sparta Rotterdam, where he enjoyed success.

[8] He scored the only goal, as Sparta beat ADO Den Haag 1–0 in the KNVB Cup final.

He was eventually named team captain, and scored six goals in three games against Luxembourg to help Denmark qualify for the 1964 European Nations' Cup.

He was the first player to benefit from new rules by the Danish Football Association allowing ex-professionals to re-enter the national team.

He ended his career with 42 international goals, the third overall goalscorer for Denmark behind Poul "Tist" Nielsen (52) and Pauli Jørgensen (47).

At 1.71 m of height,[6] Madsen was a short, exceptionally fast striker with immense fighting spirit, and a knack for physical infighting.