Horvath was born to an ethnic Hungarian family that emigrated from Transcarpathia after the end of World War I, when it became part of Czechoslovakia.

On August 18, 1955, the Red Wings traded Horvath and Dave Creighton to the New York Rangers in exchange for Aggie Kukulowicz and Billy Dea.

[2] Horvath is perhaps best remembered for his time playing on the famous "Uke Line" with the Boston Bruins, with Ukrainian-Canadians Johnny Bucyk and Vic Stasiuk.

He moved to South Yarmouth, Massachusetts, when he was named coach of the Cape Cod Cubs, an expansion team in the Eastern Hockey League, in 1972.

Horvath returned as coach for the 1973–74 season with the Cubs, who were charter members of the new North American Hockey League, but was fired after the team got off to a slow start.