[1] Brayboy attended Johnson C. Smith University (JCSU), a historically black school located in Charlotte, North Carolina.

Said to have possessed "glue-tipped fingers" as a receiver and an uncanny ability as a defender to stop opponents' running plays in their tracks,[2] Brayboy was named to the Colored Intercollegiate Athletic Association for four successive years, beginning with his freshman season in 1939.

[3] Only fearsome consensus All-American Michigan lineman Julie Franks — at the time still a rare example of an African-American man playing on an integrated Division I team — was a better black player in the estimation of the publication.

[3] As an undergraduate Brayboy pursued a triple academic major at JCSU, studying chemistry, physical education, and mathematics.

[5] In 1946, with the world war at an end, Brayboy returned home to Charlotte, where he took a position as an instructor of health and physical education,[5] working as well as an assistant coach to the Golden Bulls football team.

[6] After a brief leave of absence to focus on studies, Brayboy was named head football coach of the Golden Bulls from in September 1949.

[5] Brayboy was also a member of the Mecklenburg County Recreation Commission from 1968 to 1973 and past president of the local chapter of Phi Delta Kappa.

[1] At the time of his death, his longtime friend and coworker, Eddie McGirt, head of the athletics department at JCSU, remembered Brayboy as an outstanding campus personality.