The early libraries were generally small, offered a narrow range of services, and operated on a fee schedule.

In 1897, the Tennessee General Assembly authorized cities of a certain size to establish and maintain free public libraries and reading rooms.

The city accepted those terms, and in 1904, the Carnegie Library Building was completed on Polk Avenue.

[5] Previously on the site for the Main Library was a downtown shopping mall called Church Street Center.

[7] In 1912, Andrew Carnegie offered another $50,000 to the Nashville City Council for the creation of two new library branches: one for white residents and the other for African-Americans.

[11] The Hadley Park Branch Library opened in 1952 and was built to serve the African-American community.

[14] The library offers digital collections, e-book and audiobook downloads, language learning services, and computer classes.

Called "Limitless Libraries," this program offers access to approximately 1.5 million information resources.

In 2017, NPL eliminated overdue fines in order to increase accessibility of book borrowing.