He played college football at North Alabama, where he broke program records in completions and touchdown passes and was a two-time Harlon Hill Trophy finalist.
[1] He then transferred to then-Division II North Alabama to play for head coach Mark Hudspeth.
[3] Milwee worked as a graduate assistant at his alma mater North Alabama under Terry Bowden from 2009 to 2010, and later at East Mississippi Community College in 2011 as their quarterbacks coach.
[6] He was later hired to be the offensive coordinator at Arkansas State under former Alabama analyst Butch Jones before accepting a position at Texas.
[7] Milwee was hired away from Arkansas State as the quarterbacks coach at Texas under former Alabama offensive coordinator Steve Sarkisian.