The CDP is in central Orleans County, south of the geographic center of the town.

The Black River, a tributary of Lake Memphremagog, flows through the community, passing north of the village center which is sited on a hilltop.

Vermont Route 14 passes through the village, leading north 5 miles (8 km) to Coventry and southwest 7 miles (11 km) to Albany.

Vermont Route 58 joins Route 14 in the village center but leads east 4 miles (6 km) to Orleans and west 9 miles (14 km) to Lowell.

Newport, the county seat, is 11 miles (18 km) to the northeast of Irasburg.