He was the last surviving member of the Kardomah group, a literary and artistic circle in Swansea circa 1930, which included Dylan Thomas, Vernon Watkins and Daniel Jones.
After school he and Thomas both become journalists for the South Wales Evening Post, where Fisher's father was head printer.
He and Thomas would meet at the Kardomah cafe, with other aspiring young artists, among them Vernon Watkins, Daniel Jones, John Prichard, Mabey Owen and Keidrych Rhys.
His poems of this period were published, like those of Dylan Thomas and Vernon Watkins, in Keidrych Rhys's magazine, Wales (which had begun publication in 1937).
Fisher used his long vacations to travel widely - at first in Spain, where he became friendly with the Romani people at Granada and became an accomplished player of flamenco guitar; afterwards in Mexico, Morocco, India and east Asia.
Shortly before his death he completed his memoir, Adios Granada, about his life with Romani people in Sacremonte, Spain, in the 1950s and 1960s.