Founded in 1921, the club changed its name several times in its early stages, being known as Soko, BSK and finally HŠK (during the Axis occupation of Yugoslavia).

[2] They adopted the new name Jedinstvo following the end of World War II in 1946, becoming a member of the Novi Sad Football Association.

[3] However, the club instantly won the Serbian League Belgrade to earn promotion back to the second tier in 2003.

They became the biggest surprise of the competition's inaugural 2006–07 season (despite playing their home games at Železnik), placing fourth and securing a spot in the 2007–08 UEFA Cup.

However, the club was eliminated in the first qualifying round by Albanian side Besa Kavajë on the away goals rule (2–2 on aggregate),[4] without losing a game.