[4] Born in Tannymorel near Warwick, Queensland he attended Toowoomba Grammar School and played rugby league there.
He was a seasonal labourer in country Queensland when at age 20 he played in a game against the visiting Toowoomba Brothers club who signed him up.
He first represented for Queensland at age 27 and then consistently for the next 9 years making a then record of 34 appearances against New South Wales.
At thirty-four years of age Madsen was recalled to the 1936 Australian side in the Third Test against England in Sydney.
[9] In 2008, rugby league in Australia's centenary year, Madsen was named at front row forward in the Toowoomba and South West Team of the Century.