Grimley was a rugby league full-back while growing up in Brisbane and only took up Australian football after leaving school.
He started out in the Wilston Grange junior team but soon broke into the seniors and in 1955 played in the club's first ever QANFL premiership.
In just his second appearance, but first full game, Grimley kicked six goals from full-forward against Geelong at Kardinia Park.
[2][3] After he returned to Wilston Grange in 1958 he is credited as having convinced the club to adopt a Gorilla as their logo, which Fitzroy had changed from the previous year.
[4] In 2003, Grimley was named as the ruckman in the official "Queensland Team of the Century", next to rovers Michael Voss and Jason Akermanis.