He is primarily remembered for his role in the introduction of compulsory voting for federal elections, which became law in 1924 through his private senator's bill.

Payne's support for spending cuts led him to propose the closure of the University of Tasmania; he also called for direct taxation to be reduced.

He submitted a minority report criticising the labour movement and publicly accused the other two commissioners of misrepresenting the evidence presented to them.

[4] In 1909 Payne assisted in the creation of the Liberal League, winning re-election in the new multi-member seat of Darwin at that year's state election.

In office he "continued his efforts to shift tax onto 'unearned' wealth and was happy to increase expenditure on education, railways, agricultural improvement and assistance to immigrants".

In November 1918, he challenged George Becker, a Labor MP of German ancestry, to a fistfight following a perceived slight, and subsequently "through the open door from the House .

[5] Payne was re-elected to further six-year terms at the 1925 and 1931 elections, joining the new United Australia Party (UAP) upon its creation in early 1931.

He stated his support for a "sane protective policy" and according to Roe "upheld nineteenth-century ideas as to world-ranging free trade being the best guarantor of peace and prosperity".

[1] He took an interest in international affairs, visiting Europe, North America and Japan while in office and helping establish a local branch of the Inter-Parliamentary Union.

[9] Payne stated that compulsory voting was necessary to counteract "apathy and indolence",[1] but in his second reading speech also hoped that it would bring "a wonderful improvement in the political knowledge of the people" and lead to a higher quality legislature.

[13] Outside of compulsory voting, Payne advocated proportional representation for Senate elections[1] and for drawing boundaries so communities were not divided between two House of Representatives electorates.

[11] Prior to his election to the Senate he had also served on a select committee into Tasmania's Electoral Act, which suggested that party affiliations be listed on ballot papers.