The history[1] of the club began in 1920, when a handful of young men from Gundelfingen bought a football and formed the "Wald- und Wiesenclub".

The club survived the turbulent days of 1923 with its hyperinflation, travelling to away matches on horse-drawn carts, and went on to win its first title in 1924 when they won the C-Klasse and gained promotion to the B-Klasse.

The club did not distinguish itself in competition in those years and suffered a 0–9 defeat against BC Augsburg in 1937 regional cup match.

Success returned in 1939 with the capture of the Kreisklasse Nord title, followed by an unbeaten run through the promotion round into the Bezirksklasse Schwaben.

With the start of World War II, FCG fielded only a first team as, throughout the country, young footballers were drafted to the army.

Playing a reduced league program, the club still performed rather well, defeating FC Lauingen 9–2 in the 35th edition of the local derby.

Of the 119 members on the roll in 1945, 42 were still away as prisoners of war, 28 had lost their lives and five were missing in action, leaving the club heavily depleted.

They won the first ever Schwaben Cup in 1947, and on 13 June 1948 played their final game at their longtime home ground Am Pflanzengarten before moving to a new facility.

German football was reorganized in 1963 with the establishment of the national first division Bundesliga and restructuring of all other lower-tier leagues.

Qualifying for the DFB-Pokal (German Cup), FC Gundelfingen narrowly lost to Bayer Uerdingen 1–0 at home, in front of 4,500.

They earned generally good results there, except for a scare in 2006–07 that saw the team struggle through the first half of the season before recovering and ultimately finishing 10th.