As of 2016, he has released five records with The Veils: The Runaway Found (2004), Nux Vomica (2006), Sun Gangs (2009), Time Stays, We Go (2013), and Total Depravity (2016).

He's known for his extremely cathartic live performances and his unique singing voice[2] guesting on albums by Brian Eno, Shriekback and The Mint Chicks on backing vocals.

In 2017, Finn appeared in David Lynch's new series of Twin Peaks performing "Axolotl".

He uses very few guitar pedals generally restricted to just a Boss tuner, Diamond Delay and a Crowther Audio Hot-Cake Overdrive.

Finn uses vintage Fender Deluxe Reverb Amplifiers in the studio and a reissue for touring purposes.