Elsey came to note as a rugby player while playing for first class Welsh team Cardiff.
Despite being English born there was a two-year residency rule that allowed non-Welsh born players representing the Wales national team, and in 1895 he was selected to represent Wales as part of the Home Nations Championship.
The Welsh team had changed much since the previous match of the lase season, with only six of the original fifteen reselected, though only Elsey and Swansea's Tom Jackson were new caps amongst the forwards.
Despite being in a far more experienced team, Elsey found himself on the losing side as the English won 14–6, scoring four tries.
Even with a score on his international debut, Elsey was replaced for the next match of the Championship by Ernie George and never represented Wales again.