The park is located between the city's post office and the Dubuque Museum of Art.

Shrubs and flowers were planted, walkways were established, and a 40-foot (12 m)-high Oriental gazebo was built on the grounds for $200.

[3] This gazebo, which was built by local architects Fridolin Heer and Edward Eaescher, was widely viewed as one of the finest pavilions in the area.

Cogswell had promised the city that he would donate a statue for the fountain (which was supposed to be of a local heroine who had walked some distance to stop a train before it could come to a washed out bridge and derail).

Public events at the square over the years included Buffalo Bill Cody's "Authentic Wild West Show" performing in 1896 and President William McKinley giving a speech in 1899.

A new steel 3/4 size replica of the original gazebo built by Bradley Iron Works was placed on the site.

Once the boxes filled the vault it was sealed and buried right next to the southern side of the gazebo under the rock with the plaque that explains it is not to be opened for 100 years.