Bronze-Age rock carvings have been discovered near Bayil, and a bronze figure of a small fish in the territory of the Old City.

[4] Near Nardaran, a place called Umid Gaya features a prehistoric observatory, where images of the sun and of various constellations are carved into rock together with a primitive astronomic table.

[5] Further archeological excavations have revealed various prehistoric settlements, native temples, statues and other artifacts within the territory of the modern city and around it.

[6] According to the 6th-century archbishop and historian St. Sophronius of Cyprus, in 71, St. Bartholomew the Apostle was preaching Christianity in the city of Albana or Albanopolis,[7] associated with present-day Baku[8] or Derbent,[9] both located by the Caspian Sea.

St. Bartholomew managed to convert even members of the local royal family who had worshipped the idol Astaroth, but was later martyred by being flayed alive and crucified head down on orders from the pagan king Astyages.