Two-thirds of county was covered by the Sevan or Shahdagh mountain range of Lesser Caucasus which formed the natural boundary between the Erivan and Elizavetpol Governorates, extending from the southwest towards the northeast, then meeting the Kura River in the lowlands.

[4] The Kazakh sultanate existed in the area of the county from the 15th century until its incorporation into Russian Empire along with Georgian territories.

Since the collapse of Russian authority in the Transcaucasus, the southwestern mountainous portion of the county including the town of Dilijan which possessed an overwhelmingly Armenian population was incorporated into the Republic of Armenia in the December of 1918, following the withdrawal of the occupying Ottoman forces.

This arrangement persisted until the Kazakh uezd was formally abolished in 1929 by Soviet authorities, leading to the formation of the Qazakh Rayon on August 8, 1930 in its place.

[4] The subcounties (uchastoks) of the Kazakh uezd in 1912 were as follows:[7] The county ranked first in Elizavetpol Governorate for the number of its male population.