[1] He had suffered from overwork, and in July 1817 set out to recover his health by a foreign tour, which extended to Greece, Constantinople, and Jerusalem, a journey attended with some risk in those days.
His father had now moved to Westfield Lodge, Brighton, and soon afterwards built the proprietary chapel of St. Mary's in that town.
Elliott himself gave liberal donations, many of them anonymously, and during the rest of his life took an active part in its management.
In September 1849 the new church of St. Mark's, intended to provide for the district of Kemp Town and St. Mary's Hall, was opened, after many obstacles had been overcome by Elliott's energy and liberality.
In 1852 he spoke at a public meeting against the proposal for opening the Crystal Palace on Sundays, and his remarks were taken to amount to a charge of venality against the Times for defending the measure.
On 31 October 1833 Elliott married Julia, daughter of John Marshall of Hallsteads, Ulleswater, some of whose religious poems are given in Lord Selborne's 'Book of Praise.'
Her death was followed by those of his mother, 16 April 1843, his favourite sister, Mary, three months later, and his eldest son, Henry Venn, from the effects of a fall, on 2 June 1848.