Born on February 23, 1803, in New Kent County, Virginia, Halyburton received an Artium Baccalaureus degree in 1823 from Harvard University and attended the University of Virginia School of Law.

He entered private practice in New Kent County starting in 1824.

[1] Halyburton was nominated by President John Tyler on June 15, 1844, to a seat on the United States District Court for the Eastern District of Virginia vacated by Judge John Y. Mason.

He was confirmed by the United States Senate on June 15, 1844, and received his commission the same day.

His service terminated on April 24, 1861, due to his resignation.