Baker grew up in Portland, New South Wales but made the move to Sydney and played his first grade match for Western Suburbs in 1968.
Baker spent a largely unsuccessful time with Wests as the club finished towards to bottom of the table and claimed a wooden spoon in 1971.
In 1975, Parramatta signed former St George legend Norm Provan as coach and the club had a major form reversal qualifying for the finals.
The following year in 1977, Baker was part of the Parramatta side which won its first minor premiership and qualified for its second grand final.
In the grand final replay, Baker resumed his position at second-row but Parramatta were outplayed in the match and lost 22-0.