The first station in Kharkiv was built in 1869 by famous Russian architect Andrey Ton.

However, with the development of railways (especially after the opening of the road to Balashov in 1895) in 1896–1901, the station was expanded and modernized by architect I. Zagoskin, (and completed by architect J. Caune), became one of the largest in the Russian Empire.

The current (third) station is built in the "Stalin Empire style" with elements of classicism.

It was opened on 2 November 1952 to replace the previous station, which was destroyed during World War II.

Between 1978 and 1982, the building was expanded to the South (to the left of Station Square) in a contemporary style by the project of the Institute Khargiprotrans (architects Y. Murygin, L. V. Gurova, L. P. Yushkin, S. A. kukhtin, and A. N. Zhirnov).