The objective is to allow the communication between them and the use of gestures and hand movements to be more intuitive, Finger tracking systems have been created.
These systems track in real time the position in 3D and 2D of the orientation of the fingers of each marker and use the intuitive hand movements and gestures to interact.
Applying these rotations to kinematic chain, the whole human hand can be tracked in real time, without occlusion and wireless.
Hand inertial motion capture systems, like for example Synertial mocap gloves, use tiny IMU based sensors, located on each finger segment.
Inertial sensors can capture movement in all 3 directions, which means finger and thumb flexion, extension and abduction can be detected.
In the case when we are exposed to operate under difficult conditions like bad illumination, motion blurs, malformation of the marker or occlusion.
Users of optical mocap systems claims that the most post-process work is usually due to finger capture.
This way any 3rd party software (for example MotionBuilder, Blender) can apply motions from two sources, independently of the mocap method used.
The robust and flexible qualities of these sensors leads to high fidelity finger tracking and feature in mocap gloves produced by StretchSense.
Each hand configuration generates a set of images through the detection of the borders of the occlusion of the finger’s joint.
The finger joints have the added 21 states more than the rigid body movement of the palms; this means that the cost computational of the estimation is increased.
Anyway, we can say that a very general way and in most systems, you should carry out the following steps: It is also possible to perform active tracking of fingers.
In any case, the main objective is to facilitate the task of executing commands to the computer via natural language or interacting gesture.
The objective is centered on the following idea computers should be easier in terms of usage if there is a possibility to operate through natural language or gesture interaction.
The main application of this technique is to highlight the 3D design and animation, where software like Maya and 3D StudioMax employ these kinds of tools.