According to the United States Census Bureau, in 2000 the CDP has a total area of 1.8 square miles (4.7 km2), all land.

Also located in Point of Rocks are the remnants of the original Almond Stage Station, built in 1862 at the behest of Ben Holladay.

Holladay wished to move his stage coach line further south because of repeated attacks by Indians.

The station was constructed of local sandstone with a sod-covered roof, which allowed it to survive at least one attack and attempted burning.

When mining declined in the area the station was sold and used as a private home before being absorbed by the Wyoming State Parks and restored.