Gilchrist releases music under the name Stephen Evens (stylised Stephen EvEns) and wrote and recorded under the name Stuffy with his band Stuffy/The Fuses (whose second album, Angels Are Ace, was recorded by Steve Albini) from 2003 to 2009, reforming in 2023.

Gilchrist supplied the drums for the Graham Coxon and Jimmy Pursey's single supporting the England national football team at the 2006 FIFA World Cup.

In 2013 he joined Art Brut, replacing founding member Mikey Breyer.

He has also toured and recorded with Charlotte Hatherley, Cardiacs and Cathy Davey.

Gilchrist endorses Sabian cymbals, Mapex Drums and Vic Firth sticks.