On his brother's death in 1855, Edward Pryse declined to contest the seat and John Lloyd Davies was elected as a rare Conservative MP for the constituency at the ensuing by-election.

[7] Matters came to a head on 29 May when a Liberal conference was held at Aberaeron to consider the representation of both the borough constituency and the Cardiganshire county seat.

[10] In 1886, he opposed Gladstone's Home Rule proposals and supported David Davies who stood as a Liberal Unionist candidate for Cardiganshire in 1886.

[10] Davies was narrowly defeated and it was a blow to the prestige of the House of Gogerddan that the family had supported a losing candidate.

[10] Pryse did, however, invite the winning candidate, Bowen Rowlands, to his home shortly after the election, appointed him a JP for the county and "generally accepted the situation with the best grace possible".