Named after Queen Victoria's youngest son, the Duke of Albany, the club has been situated at its present location of 91 King Street East since 1898.

Its members have included every Conservative prime minister from Sir John A. Macdonald to Stephen Harper.

Drew, Leslie Frost, John Robarts, Bill Davis, Frank Miller and Mike Harris.

[1] The current clubhouse at 91 King Street East was designed by Charles J. Gibson (1862–1935)[3] and completed in the early 1930s.

[4] Its west side is directly adjacent to the last remaining portion[5] of "Victoria Row",[6] which was originally constructed by John George Howard from 1840 to 1842 as a commercial building.