He was appointed as a deputy lieutenant sheriff of Southampton in January 1831 but in another general election later that year he trailed badly and, after a four-day poll, he stood down.
[1] He narrowly won his parliamentary seat back in the general election of 1832, beating Penleaze by 604 votes to 594,[3] but Hoy was then accused of voter impersonation; apart from claiming to have no knowledge or involvement in the matter he offered no defence and he was unseated.
[1] Hoy was acclaimed at archery and shooting, and in September 1830 he won first prize in the Southampton New Forest Archers' competition, having "'distinguished himself by the accuracy of his aim" in July of that year.
[1] On 10 September 1831, after Hoy had lost his parliamentary seat, he married Marian D'Oyley, the daughter and heiress of Shearman Bird who owned Harold's Park near Waltham Abbey in Essex.
[1] In August 1843, Hoy was again abroad due to his wife's ill health and he took the opportunity to pursue his hobby of seeking specimens of rare birds.
He was with a shooting party in the Pyrenees and when crossing a ravine on the Spanish side of the border he dropped his gun and it fired, shattering his left arm.
Part of The Hermitage estate passed to Louisa, while Hoy's Widow, Marian, subsequently married John Richard Digby Beste, an author from Botley in Hampshire.