A native of New York City, Flory was playing guitar by his early teens and around that time heard his first jazz album, Forest Flower by Charles Lloyd.
[1] He met musicians through his friend Scott Hamilton and while babysitting the children of Gil Evans he listened to albums by Nat King Cole, Miles Davis, Charlie Parker, and Lester Young.
[2] Flory played in rock bands in his early teens but three years later had a couple jazz lessons with guitarist Tiny Grimes.
[1] He has worked with Ruby Braff, Judy Carmichael, Roy Eldridge, Illinois Jacquet, Buddy Tate, Bob Wilber,[3] Milt Hinton, Hank Jones, Duke Robillard, and Maxine Sullivan.
[1] With Ruby Braff With Scott Hamilton With Maxine Sullivan With Bob Wilber With others