Ballard was born in Brentford and spent the war years working in a munitions factory in Hayes, Middlesex.
His birthplace was only 50 yards from Griffin Park and he made one wartime appearance before signing as a professional for Leyton Orient in April 1946.
[3][5] He made his debut for Southampton at home to West Ham United on 31 January 1948, replacing the injured Joe Mallett at centre half.
[5] At Orient he failed to break into the first team and in 1953 joined Snowdown Colliery Welfare in the Kent League for three seasons.
[8] He became manager of the Clarence public house in Hastings for a few years before becoming a franchising officer for Green Shield Stamps during the 1970s.