Beginning his musical career in 1978, he is primarily known as the lead vocalist and bass player of pioneering crust punk band Amebix.
[5] When Miller was involuntarily discharged from his role as an Air Training Corps sergeant in 1978, due to being intoxicated while on duty when stationed in the Netherlands.
In 1981, Miller and Amebix relocated to Peter Tavy and began living with new drummer Martin Baker in Glebe House, the former site of a Saxon burial ground.
They released their debut EP Who's the Enemy on 28 August 1982 through Spiderleg Records, whom they had been turned onto in the brief period they were living with Crass.
Independent Music Chart, and gained them the attention of Dead Kennedys vocalist Jello Biafra, who signed them to his record label Alternative Tentacles.
[8] While working in a hotel, Miller met a man whom he described as having "very abstract ideas about mythology", which led to him wanting to a pursue a career as a swordsmith.
[13] In July 2019, Tau Cross were suddenly removed from their contract with Relapse Records, after it was discovered that Miller had thanked a prominent Holocaust denier, Gerard Menuhin, in the liner notes for their up-and-coming third album Messengers of Deception.
[15] Miller identifies as gnostic and believes that the universe is an illusion created by a powerful force, that "is not conscious of the fact that it's not God itself".