Roukounas came from a poor family and thus had to start working from the age of eight, initially at a cigarette manufacturing business and later as a carpenter.
Young Roukounas soon became famous among his fellow islanders of Samos for his fine voice, specialising in Smyrneika (songs originating from the nearby coast of Asia Minor).
There he sang professionally on various festive occasions until he was discovered by Panagiotis Toundas, a leading composer and recording industry executive.
With his versatile voice he excelled in virtually all subgenres of traditional and rembetic music.
Roukounas collaborated with many composers throughout his long career, particularly Panagiotis Tountas, Spyros Peristeris, Kostas Skarvelis, and Grigoris Asikis.