He collaborated again with Jack White in the band Two Star Tabernacle, mixing elements of raw country and garage rock.

The band's critically acclaimed debut album, If We Can't Trust the Doctors, was released on V2 Records at the end of 2004.

As part of the promotion for the release of Walk The Line, Miller performed solo along with the Tennessee Three at the ArcLight Theatre in Hollywood.

An acclaimed audiobook narrator,[4] Miller was named a Best Voice by AudioFile magazine for performances of Pat Conroy's The Lords of Discipline and Philip Roth's My Life As a Man.

Miller plays a Harmony H60 Meteor archtop guitar mostly on tours with a Fender Twin Reverb amplifier and occasionally a Danelectro Daddy-O distortion pedal.