One of the issues that I have been encountering while developing the controls for the system is replicating fine movements, this being the rotation of the hand which can be used to move the tools or the deformable object. This is due to the way the Kinect works, it can detect individuals within its field of view but cannot detect small movements such as the rotation of the wrist. Therefore I have decided to add an additional method of control to the system, the myo a gyroscopic armband that allows for both gesture and fine motor control.
With the myo I can now track the rotational movement of the system and use a number of unique gestures to perform actions in the system. I will outline these unique gestures and how I will use them in a future post.