In the past, the club has won Greece's top-tier level Greek Basket League twice, in the years 1959 and 1992.

They won the now defunct European-wide secondary level competition, the FIBA Saporta Cup, in the 1990–91 season.

The team was crowned the Champions of Greece, with the following players; Dapontes, Kyriakou, Oikonomou, Paschalis, Stalios, Kokkos, Theoridis, Angelidis, Stergiou, Konstantinidis, and player-coach Irakleios Klagas.

The worst season of the club to date was in 1976–77, when PAOK avoided relegation, with a 66–53 play-out win over Dimokritos.

The Athenians managed to scrape through to a two-point victory, despite the game being played in Alexandreio Melathron, which was PAOK's home arena at that time.

He had a number of injuries and medical emergencies because of weak legs, but he would constantly choose to take heavy dosages of painkillers, rather than missing out on important games.

In the following 1991–92 season, PAOK once again reached the final of the same competition (then called the FIBA European Cup), but they lost to the Spanish League club Real Madrid Asegurator, by a score of 65–63.

In the 1992–93 season, PAOK had a starting five unit of Jon Korfas, Bane Prelević, Cliff Levingston, Ken Barlow and Panagiotis Fasoulas, and was led by head coach Dušan Ivković.

PAOK lost in the semifinal game to the then defending Italian League champions Benetton Treviso, which was led by the Croatian star Toni Kukoč, by a score of 79–77.

Two days later, in the third-place game, PAOK defeated Spain's Real Madrid Teka, which was led by the Lithuanian star Arvydas Sabonis and American Rickey Brown.

That marked the end of a long period of time, in which the club had shared the home court of Alexandreio Melathron with Aris.

Bane Prelević returned to PAOK, after having quick spells at Kinder Bologna and AEK Athens, and then quit playing basketball at the end of the 1999–00 season.

PAOK played in EuroLeague Basketball's inaugural 2000–01 season, where they made it to the Round of 16, and lost to the Slovenian League club Union Olimpija.

Prelević became the team's head coach for the 2002–03 season, and he led them to a short winning streak during the year.

PAOK finished in 6th place in the 2003–04 Greek League season, with a squad full of talented young players, like Panos Vasilopoulos, Kostas Vasileiadis and Loukas Mavrokefalidis.

PAOK made it to the ULEB Cup's quarterfinals that season, where they lost to the Lithuanian League club Lietuvos Rytas.

In that same 2007–08 season, PAOK also had a disappointing finish in the now defunct European-wide third- level competition, the FIBA EuroCup (EuroChallenge).

After finishing in 5th place in the Greek League in the 2016–17 season, the club replaced head coach Soulis Markopoulos with Ilias Papatheodorou.

2020–21 PAOK started the new decade from the scratch, with a new contributor Thanasis Chatzopoulos, PAOK kept the team's leader Vangelis Margaritis, brought in some talented young players such as Elijah Mitrou-Long and gave more playing time to athletes from his academy, like Konstantinos Iatridis.

These changes seem to be the first step in returning to the higher positions of the Greek League, as well as a steady comeback to European competitions.

After that, PAOK played its home games for many years at the 5,183 seat Alexandreio Melathron (Nick Galis Hall).