It is located on the west side of the University's inner city Parkville campus, near the corner of Grattan Street and Royal Parade.

[3] John Francis Deighton Scarborough, a lecturer in architecture at the University, was commissioned to design the Baillieu Library in 1945.

[6] A key feature of this modernist building is the glass curtain wall with 'opaque spandrel' panels that forms the façade overlooking South Lawn on the east side.

While the tower never eventuated, substantial extensions were made to the south-west, north-west and north-east corners of the building between 1969 and 1974, adding over 7,432 square metres (80,000 sq ft) to the library's floorplan.

It collects, preserves and provides access to the historical records of the university, as well as those of Victorian businesses, trade unions, political organisations and community and cultural groups, as well as personal papers of many prominent individuals, including Malcolm Fraser and Germaine Greer.

It is a closed-access collection which comprises around 3800 books (as well as photograph albums, notebooks, periodicals, maps and ephemera) from the personal library of the former Prime Minister.

[22] One of the most significant contributions came from Dr John Orde Poynton, who donated over 15,000 volumes, including many relating to the history of fine printing and the art of the book.

[23][24] The Friends of the Baillieu Library was established in 1966 with the purpose of funding the acquisition of new resources; members meet regularly for a programme of cultural and educational events.