Edwards was a determined Liberal and a supporter of the Disestablishment of the Church in Wales, of which he was a member.
In 1894, Edwards joined with David Lloyd George, David Alfred Thomas, and Herbert Lewis in resigning the Liberal Whip in protest at the delay of the Government of Lord Rosebery in introducing a Welsh Disestablishment measure.
[3] Defeated in 1895, Edwards was to play no part in the struggle to unite Welsh Liberalism under the auspices of Cymru Fydd.
Edwards appears to have been viewed as under the 'baleful' influence of David Alfred Thomas by Lloyd George and Herbert Lewis.
In 1900, Edwards fought Radnorshire on a platform of opposition to the Boer War and returned to parliament.