In 1892, the Roman Catholic Diocese of Cleveland purchased approximately 105 acres (420,000 m2)[1][2][3] of land east of Broadway Avenue in what was then Newburgh Township.

[3][9] Within just a few years, the cemetery featured a stone receiving vault, waiting room at the entrance, and a number of roads.

[10] Initially, the cemetery was bounded on its east side by the Connotton Valley Railway, whose tracks were laid in 1882.

[20] A large memorial angel atop a pedestal inscribed "Our Babies" was dedicated on November 2, 1952, in what is now section 105 of the cemetery.

Overlooking the section, the cemetery constructed a grotto and placed a life-size terracotta statue of Christ in the niche.

[24] A statue of Our Lady, Queen of Heaven was erected at the E. 100th Street entrance of Calvary Cemetery in 2001.

[25] After the Diocese of Cleveland closed or merged more than 75 parishes between 2006 and 2010, several works of art were moved to Calvary Cemetery.

After St. Hyacinth Church closed in September 2009, its monument to Catholic war veterans was moved to the entrance of Calvary Cemetery.

In 1960, parishioners erected a life-size statuary group to honor church members who had died in World War II.

After months of discussion with former St. Margaret parishioners, the diocese agreed to reinstall the complete grouping near the cemetery's 116th Street entrance, where many World War II dead are buried.