Bent fingers' angle calculation using supervised ANN to control electro-mechanical robotic hand

The shape of human hand is such that it can perform many tedious tasks easily. It can reach narrow places and can perform difficult operations. It can bend its fingers at different angles to pick or hold different objects and apply force via fingers or palm area. It is very helpful in many difficult applications. However, there is risk of injury to the human hand, or even life in dangerous operations. It is not advisable to gamble of human body parts for applications like land mine removal. Hence, there is a need of a robotic hand which can perform the same operation as a human hand does in real time. This paper discusses a vision-based technique of controlling a robotic hand which has human hand like joints in fingers. The user has to show a gesture to the system with bare hand without any limitation on hand direction and the robotic hand would mimic that gesture. The positions of human hand fingers were calculated using supervised Artificial Neural Network. The preprocessing made the whole algorithm faster by cropping the region of interest from input image frame. The gesture was extracted from the input image and fingertips, centre of palm were detected. The animated simulation of robotic hand is done in Blender(R) software.

[1]  Sebastian van Delden,et al.  Visual detection of objects in a robotic work area using hand gestures , 2011, 2011 IEEE International Symposium on Robotic and Sensors Environments (ROSE).

[2]  Ankit Chaudhary,et al.  A Survey on Hand Gesture Recognition in Context of Soft Computing , 2011 .

[3]  Heng-Tze Cheng,et al.  Imirok: Real-time imitative robotic arm control for home robot applications , 2011, 2011 IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM Workshops).

[4]  Chong-Won Lee,et al.  A new exoskeleton-type masterarm with force reflection based on the torque sensor beam , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[5]  Radu Mihnea Udrea,et al.  Visual-oriented morphological foreground content grayscale frames interpolation method , 2009, J. Electronic Imaging.

[6]  Ankit Chaudhary,et al.  A Vision based Geometrical Method to find Fingers Positions in Real Time Hand Gesture Recognition , 2012, J. Softw..

[7]  Jochen Triesch,et al.  Robotic Gesture Recognition , 1997, Gesture Workshop.

[8]  DaeEun Kim,et al.  Finger-gesture Recognition Glove using Velostat (ICCAS 2011) , 2011, 2011 11th International Conference on Control, Automation and Systems.

[9]  Mohan M. Trivedi,et al.  3-D Posture and Gesture Recognition for Interactivity in Smart Spaces , 2012, IEEE Transactions on Industrial Informatics.

[10]  Hanseok Ko,et al.  Motion primitives for designing flexible gesture set in Human-Robot Interface , 2011, 2011 11th International Conference on Control, Automation and Systems.

[11]  Alex Pentland,et al.  Real-time American Sign Language recognition from video using hidden Markov models , 1995 .

[12]  Kazuo Kyuma,et al.  Computer vision for computer games , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[13]  Dieter W. Fellner,et al.  Interaction with hand gesture for a back-projection wall , 2004, Proceedings Computer Graphics International, 2004..

[14]  Ankit Chaudhary,et al.  ABHIVYAKTI: Hand Gesture recognition using Orientation histogram in different light conditions , 2011, IICAI.

[15]  Nicolae Vizireanu,et al.  Generalizations of binary morphological shape decomposition , 2007, J. Electronic Imaging.

[16]  Daeho Lee,et al.  Vision-based remote control system by motion detection and open finger counting , 2009, IEEE Transactions on Consumer Electronics.

[17]  Maria Pateraki,et al.  Visual estimation of pointed targets for robot guidance via fusion of face pose and hand orientation , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[18]  Minoru Fukumi,et al.  Operation improvement of indoor robot by gesture recognition , 2011, 2011 Fourth International Conference on Modeling, Simulation and Applied Optimization.

[19]  Luc Van Gool,et al.  Real-time 3D hand gesture interaction with a robot for understanding directions from humans , 2011, 2011 RO-MAN.

[20]  Panos E. Trahanias,et al.  Gesture recognition based on arm tracking for human-robot interaction , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  Duanling Li,et al.  Principle and mechanical analysis of a pneumatic underactuated bionic hand , 2009, 2009 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[22]  Yi Zhang,et al.  A novel intelligent wheelchair control system based on hand gesture recognition , 2011, The 2011 IEEE/ICME International Conference on Complex Medical Engineering.

[23]  Yixin Chen,et al.  Efficient algorithm for training neural networks with one hidden layer , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[24]  Helge J. Ritter,et al.  Visual recognition of continuous hand postures , 2002, IEEE Trans. Neural Networks.

[25]  Ankit Chaudhary,et al.  An ANN Based Approach to Calculate Robotic Fingers Positions , 2011, ACC.

[26]  Ankit Chaudhary,et al.  An Efficient Real Time Method of Fingertip Detection , 2011, ArXiv.

[27]  Othman O. Khalifa,et al.  Electromygraphy (EMG) signal based hand gesture recognition using artificial neural network (ANN) , 2011, 2011 4th International Conference on Mechatronics (ICOM).

[28]  Clément Gosselin,et al.  An anthropomorphic underactuated robotic hand with 15 dofs and a single actuator , 2008, 2008 IEEE International Conference on Robotics and Automation.

[29]  Yang Wang,et al.  Max-margin hidden conditional random fields for human action recognition , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Stefan Kopp,et al.  A friendly gesture: Investigating the effect of multimodal robot behavior in human-robot interaction , 2011, 2011 RO-MAN.