[1] Her father, a musician who played several instruments[1] including trombone for the Leeds Symphony Orchestra,[2] began teaching her the piano at the age of five.

[3] Ivy's father had ambitions for her to become a concert pianist, but she was inspired to become a jazz musician after hearing a Benny Goodman record and learned to play clarinet and alto saxophone.

[1][3] She left school at 14[1] and took a job at the Montague Burton factory in Leeds, putting aside half a crown from her wages each week to save up for her first saxophone.

[1] She and the band were scheduled to take part in a BBC Television broadcast in 1946, but were forced to cancel 48 hours before they were due to go on air following a dispute with the Stoll Theatres Corporation, who she was contracted to.

[4] Benson retired to the seaside resort of Clacton-on-Sea, Essex, occasionally entertaining local holidaymakers on the electric organ.

[10] In 1957, she married Top Sergeant Brantley Callaway of the United States Air Force, whom she met while performing in a summer season on the Isle of Man.

[14] In 1984, The Silver Lady, a play by Liane Aukin based on Benson's life, was staged at the Birmingham Repertory Theatre.

[4][15][16] She is also mentioned in the 'Grieg's Piano Concerto, by Eric Morecambe' comedy sketch, featuring Andre Previn, shown on the BBC 'Morecambe and Wise' show, in 1971.