In 1966, Fritsen was sold to Dutch club GVAV Groningen, where his professional career lasted until 1 July 1971.

In his first season as manager in Vejle Boldklub, Fritsen won the Danish Cup.

In addition, Fritsen spend many years coaching the Vejle Boldklubs youth teams.

In his last period as manager Fritsen came from a job as youth coach in the club, where he had helped to educate players such as Thomas Gravesen, Alex Nørlund, Kaspar Dalgas and Peter Graulund.

Outside the football world Ole Fritsen was a primary school teacher, which would probably explain his flair for working with young players.