Hugh participated in the rebellion of Thomas, 2nd Earl of Lancaster and surrendered prior to the Battle of Boroughbridge in 1322.

Hugh was the fifth and youngest son of James Audley and Ela de Longspee, daughter of William Longespée the Younger.

After the death of his father in 1272, Hugh inherited Stratton Audley, Oxfordshire, the dowry of his mother.

After initial successes, Audley surrendered with his ally Maurice de Berkeley on 6 February 1322.

He was imprisoned in Wallingford Castle, where the younger Hugh joined him a few weeks later after the Battle of Boroughbridge.