Born in Bowhill, Fife, he played as a forward for Hamilton Academical, Manchester City and Stockport County.

When Herd signed for Manchester City, the team included England Internationals Eric Brook, Sam Cowan, Jackie Bray, Frank Swift and Fred Tilson and former Scotland captain Jimmy McMullan.

He was also part of the City team which beat Portsmouth 2–1 in the 1934 FA Cup Final with two goals from Fred Tilson.

In the 1934–35 football season Herd scored 14 goals and City finished fourth in the league, ten points behind champions Arsenal.

In the 1936–37 football season Herd was part of the first Manchester City side to win the League.

He also made history by playing alongside his son, David Herd, in a 2–0 win against Hartlepool United on 5 May 1951, in the 1950–51 season of the Football League Third Division North.

Herd was one of three members of his family to gain recognition for their footballing skills at national level.

He played for Scotland in one of the (unofficial) wartime international matches, a 5–4 win against England in April 1942.