Durley was the head football coach at Texas College from 1942 to 1948, compiling a record of 45–15–6.
[1] From 1949 to 1964, Durley was head football coach and director of athletics at Texas Southern University.
In their second year in the Midwest Athletic Association, Texas Southern went undefeated; in 1952 they beat Prairie View A&M in the Prairie View Bowl to win the black college football national championship;[2][3] in their first season in the Southwestern Athletic Conference, 1958–1959, they shared the league championship with Wiley College.
[4] Durley was also the tenth head football coach at Prairie View A&M University for two seasons, from 1969 to 1970.
[7] In 1992 Durley was inducted into the Southwestern Athletic Conference Hall of Fame.