Born in East Fremantle, Avery moved around north of Perth for a number of years; living in the town of Broome until the age of 6, when his parents split up.
[1] Avery initially started off as a member in the band, Red Shoes Boy, and played drums for singer Abbe May, but gradually moved off to form The Growl.
[4] As well as playing in Allbrook/Avery and Pond, Avery formed and fronted Fremantle based garage rock band, The Growl, recruiting fellow musicians Clinton Oliver, Marc Earley, Michael Jelinek, Samuel Kuzich and James Ireland.
[8] Not long after joining Tame Impala, he and Parker founded the psychedelic funk band, AAA Aardvark Getdown Services (originally named Kevin Spacey).
[10] On 21 December 2013, they played a second set under the name The Golden Triangle Municipal Funk Band, with Ben Whitt (former frontman of The Chemist) on guitar and vocals, Avery on bass and Parker on drums.
[11] On 22 February 2014 it was announced that AAA Aardvark Getdown Services would play a gig alongside Pond, Peter Bibby, The Silents and Felicity Groom, organised by Fremantle-based record label, Spinning Top.
After contributing backing vocals to Arctic Monkeys' 2018 album Tranquility Base Hotel & Casino, Avery joined them on tour as both supporting act[18] and multi-instrumentalist in the band's newly expanded live line-up.
On announcing the album Avery stated "I wanted to make something that sounded like the old records I love—Johnny Hartman, Dean Martin, Frank Sinatra, Elvis Presley, Sarah Vaughan, Etta James—the big band stuff with less metaphorical lyrics.