Born in Belfast, the son of mariner John Gyle and Fanny Woods.
Gyle was married in December 1894 to Helen Dempster, with whom he had two children.
He was suspended from the Orange Order in 1934 for seven years, because he visited Joseph Devlin MP for Belfast Central on his deathbed.
He unsuccessfully contested the 1929 Northern Ireland general election for Belfast Dock.
He was a member of the Senate of Northern Ireland from 1933 until his death on 2 December 1934.