In January 1746 he decided to give it up, and on 11 October 1746 he settled with his family in Dublin as treasurer and deputy-manager to Thomas Sheridan at the Smock Alley Theatre.
Shortly after his return to England Victor obtained the post of treasurer of Drury Lane Theatre, which he retained until his death.
Victor died at his lodgings in Charles Street, Covent Garden, London, on 3 December 1778.
Next year he composed a satire called ‘The Levée Haunter,’ which met with the approbation of Sir Robert Walpole.
From 1746 Victor wrote the birthday odes for the court of Dublin, and Lionel Sackville, 1st Duke of Dorset, when resigning the position of lord lieutenant in 1755, obtained permission to put Victor's name, as poet laureate of Ireland, on the viceregal establishment.