Born in Dublin, Bayly began his professional career as a youth player with local side Little Bray and English team Wolverhampton Wanderers.
Bayly made his senior debut on 21 April 1984 in a 3–0 loss to Ipswich Town in the First Division, the first of seven consecutive appearances.
[2] Bayly was then briefly on the books at Coventry City before returning to his native Ireland to join Sligo Rovers.
Bayly then guested for Shamrock Rovers in a tournament in South Korea in June 1987, before moving to Derry City in 1988.
After a year in Spain with UE Figueres, Bayly returned to Ireland to play with a number of clubs including St Patrick's Athletic, Derry City, St James's Gate, Athlone Town and Monaghan United, before signing with Shamrock Rovers in May 1992.