One of his siblings was an older brother, William Voris Gregory, who became a politician and US Congressman.

In 1936 William Voris Gregory was an incumbent already re-nominated by the Democratic Party for re-election in when he died on October 10 of that year.

He was re-elected ten times, serving for 22 years during his eleven terms in the House.

Gregory did not sign the 1956 Southern Manifesto but voted against the Civil Rights Act of 1957.

[1][2] In 1958 Gregory sought re-election to his seat but was defeated in the Democratic primary by Frank Stubblefield; he won the general election.