Active into the 20th century, it is one of the last extant physical remnants of Rossville, a black settlement founded near the city of Piqua in the late 1840s.

The cemetery is listed on the National Register of Historic Places because of its connection to the history of free people of color in pre-Civil War Ohio.

Beginning in the 1820s, Virginia planter John Randolph of Roanoke, a US Congressman, wrote a succession of wills in which he planned for the manumission of his more than 600 slaves, together with providing money to relocate the freedmen to the free state of Ohio and buy land for them.

Following his death in 1833, lawsuits were quickly filed to challenge probate of his estate, and twelve years passed before the litigation was finished and his 600 slaves' futures were resolved.

As ultimately resolved by the courts, his will provided for his slaves' emancipation and transportation to a free state, and western Ohio was chosen as their destination.