He had five brothers: James (1765–1819), George (1766–1838), Henry Thomas (1771–1850), Francis William (Frank) (1774–1865), Charles John (1779–1852), and two sisters, Cassandra and Jane Austen.

He married Elizabeth Bridges (1773–1808), daughter of Sir Brook Bridges, 3rd Baronet on 27 December 1791, and together they had eleven children:[1][2] For a period, some of Edward and Elizabeth's children were taught by a governess, Anne Sharp, who became a close friend of Edward's sister Jane.

Though she was with the family for only two years, Jane Austen remained in touch with Anne and referred to her as "an excellent kind friend".

[12] Edward inherited three estates from Thomas Knight, in Steventon, Chawton and Godmersham (which included a manor at Wittersham).

[13] When war broke out with France, Edward raised and was appointed Captain of the Godmersham and Molash Company of the East Kent Volunteers.