Born in Oneida, Tennessee, Phillips received a Bachelor of Arts degree from Berea College in 1965, a Juris Doctor from Vanderbilt University Law School in 1969, and a Master of Laws from George Washington University Law School in 1973.

He was in the United States Army Judge Advocate General's Corps from 1969 to 1973 and became a captain.

He was then a United States magistrate judge for the Eastern District of Tennessee from 1991 to 2002.

On June 26, 2002, Phillips was nominated by President George W. Bush to a seat on the United States District Court for the Eastern District of Tennessee vacated by James Howard Jarvis II.

He took senior status on August 1, 2013, and was succeeded by Judge Pamela L. Reeves.