Founded in 1912, Sport won nine domestic league titles and was the most successful Estonian football club before Soviet occupation.

Before World War II, the club was also active in athletics, weightlifting, wrestling, boxing, speed skating, basketball, volleyball and bandy.

[5] In the following years, Sport continued to play football matches against Finnish teams and thus grew close ties with Finland.

After a conflict with the Estonian FA, Sport along with a number of other teams decided not to take part in the 1928 season, but returned in the following year, when the championship was played in a league system format for the first time.

Tallinna Sport retained the title in 1932 and 1933, where they finished one point clear of the newly promoted JS Estonia Tallinn.

After losing 2–3 to Austria Vienna and their star player Matthias Sindelar in 1930, Tallinna Sport faced Barcelona CE Europa, who were the founding members of La Liga the year before.

Sport also won Berlin FC Preussen 3–0 in 1931 and defeated Austrian club WAC, the finalist of the same year's Mitropa Cup (considered as one of the predecessors to the Champions League), 3–1.

[8] The club was dissolved in 1941 after the Soviet Union occupied Estonia, but was re-established a year later during the German occupation and won the unofficial 1942 Estonian Cup.

Named Tallinna FK Sport, the club took part in the Soviet Second League and finished eighth in the 1985 and 1988 seasons.

In 2003, a group of people attempted to re-establish Tallinna Sport and entered the fifth tier of Estonian football.