Directly beneath the arch is the Raddatz Rockshelter, a rock shelter once used by Paleo-Indians and now listed on the National Register of Historic Places.

The park is located southwest of Baraboo between the unincorporated communities of Leland and Denzer, in the town of Honey Creek.

Outcrops of quartzite, hardened sand deposited about 1.6 billion years ago jut out of the tops of these hills.

An archaeological excavation of the rock shelter was conducted in 1957 by Warren L. Wittry of the Wisconsin Historical Society.

The arch and rock shelter are short distance up the Indian Moccasin Nature Trail, which then loops further through the wooded hills.

The longer Whitetail Hiking Trail leads across the highway to the less-used southern half of the park.