Denice as a feminine given name is of French derivation, and means "follower of Dionysius".
The name is a version of Denise (French): feminine of Dennis.