Their sister, Mary Gaunt, was a well-known author in Australia and wrote several travel books.

[1] In 1914 Gaunt was appointed naval attaché to the United States,[1] and was instrumental in infiltrating the Hindu–German Conspiracy during the First World War.

Gaunt resigned from the House of Commons in 1926, when he was cited as co-respondent in the divorce case between Sir Richard Cruise and his wife.

Gaunt married a widow, Mrs Margaret Elizabeth Worthington (daughter of Sir Thomas Wardle) at Hong Kong in 1904.

He later remarried on 1 December 1932 a 35-year-old widow, Sybil Victoria Joseph, née Grant White and had two daughters.