During the First World War, Frazier volunteered for service in the United States Army on April 21, 1917, and was discharged as a major in March 1919.

Frazier was appointed United States attorney for the eastern district of Tennessee on September 25, 1933, and served until his resignation on April 12, 1948.

[3] He was an unsuccessful candidate for renomination in 1962 to the Eighty-eighth Congress, and resumed the practice of law in Chattanooga.

He was a signatory to the 1956 Southern Manifesto that opposed the desegregation of public schools ordered by the Supreme Court in Brown v. Board of Education.

Frazier died in Chattanooga, Hamilton County, Tennessee, on October 30, 1978 (age 88 years, 129 days).