Born in Trethomas, Baker played for the works team for non-league Lovell's sweet manufacturers Lovell's Athletic, before signing for Second Division side Wolverhampton Wanderers in 1926,[3] making his Football League debut on 30 April 1927 in a 2–1 win over Fulham.
[4] Baker remained at Molineux for three seasons but only managed 17 appearances in total during this period,[3] 16 of which were in the league.
[2] He joined Coventry City in 1929,[3] where he would go on to have two spells, interspersed by a return to Lovell's Athletic.
Baker made over 108 league appearances for Coventry before moving to Bristol City in January 1935.
[2] His Bristol City stint saw Baker play in only 10 games[2] and so signed for newly formed Southern League club Colchester United in 1937, making his debut in a match against Folkestone on 23 September 1937.