Born in Coolderry, County Offaly, Carroll's family had a strong association with hurling going back several generations.
His father, Pat Carroll, was a two-time All-Ireland SHC medal-winner with Offaly who died in March 1986 at the age of 30.
[8][9] The latter victory lead to provincial success, with Carroll claiming a Leinster Club SHC medal after a defeat of Oulart–the Ballagh in the final.
He was later included on Offaly's National Hurling League panel and quickly became a regular member of the starting fifteen.
[18] He claimed his first senior silverware in 2005 when Offaly secured the National League Division 2 title after a 6-21 to 4-07 defeat of Carlow in the final.
[27] Carroll served as a coach in Ken Hogan's Lorrha management team when the club claimed the Tipperary IHC title in 2022.