A Vision based Geometrical Method to find Fingers Positions in Real Time Hand Gesture Recognition

A novel method to calculate the bended finger’s angle has presented here which could be used to control the electro-mechanical robotic hand. It is assumed that the robotic hand has the human hand like joints and same number of degree of freedom as human hand. In many applications an equipment like human hand is needed, to do the same kind of operation like human do. These days it is easy to make the electro-mechanical robotic hand which has five fingers and same joint but it is not easily controllable as the human hand for accurate work. In our method the hand gesture will be interpreted for controlling the robotic hand. The angles for all the fingers will be calculated and that could be further passed to the robotic hand for controlling its finger. User would perform gesture according to the action as he wants to be done by robotic hand. Here finger positions are detected using geometric modeling of hand in the extracted image Region of interest cropping from the image made the algorithm faster.

[1]  Ankit Chaudhary,et al.  ABHIVYAKTI: A Vision Based Intelligent System for Elder and Sick Persons , 2011, ArXiv.

[2]  Qiuqi Ruan,et al.  A Real-time Gesture Recognition Algorithm on Video Surveillance , 2006, 2006 8th international Conference on Signal Processing.

[3]  Junchul Chun,et al.  Manipulation of virtual objects in marker-less AR system by fingertip tracking and hand gesture recognition , 2009, ICIS '09.

[4]  Tiehan Lu,et al.  Design of a real-time gesture recognition system: high performance through algorithms and software , 2005, IEEE Signal Processing Magazine.

[5]  Jamshid Dastur,et al.  Robotic Arm Actuation with 7 DOF Using Haar Classifier Gesture Recognition , 2010, 2010 Second International Conference on Computer Engineering and Applications.

[6]  James L. Crowley,et al.  Finger Tracking as an Input Device for Augmented Reality , 1995 .

[7]  Ankit Chaudhary,et al.  A Vision based Real Time System to Control Remote Robotic Hand Fingers , 2011 .

[8]  Dmitry B. Goldgof,et al.  Gesture recognition using Bezier curves for visualization navigation from registered 3-D data , 2004, Pattern Recognit..

[9]  Rohit Verma,et al.  Vision based hand gesture recognition using finite state machines and fuzzy logic , 2009, 2009 International Conference on Ultra Modern Telecommunications & Workshops.

[10]  Franklin C. Crow,et al.  Summed-area tables for texture mapping , 1984, SIGGRAPH.

[11]  Daeho Lee,et al.  Vision-based remote control system by motion detection and open finger counting , 2009, IEEE Transactions on Consumer Electronics.

[12]  Chris Joslin,et al.  A Framework for 3D Hand Tracking and Gesture Recognition using Elements of Genetic Programming , 2007, Fourth Canadian Conference on Computer and Robot Vision (CRV '07).

[13]  Thomas Brown,et al.  Finger tracking for the Digital Desk , 2000, Proceedings First Australasian User Interface Conference. AUIC 2000 (Cat. No.PR00515).

[14]  Dieter W. Fellner,et al.  Interaction with hand gesture for a back-projection wall , 2004, Proceedings Computer Graphics International, 2004..

[15]  Wong Tai Man,et al.  ThumbStick: a novel virtual hand gesture interface , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[16]  Jagdish Lal Raheja,et al.  Real-Time Robotic Hand Control Using Hand Gestures , 2010, 2010 Second International Conference on Machine Learning and Computing.

[17]  Alex Pentland,et al.  Real-time American Sign Language recognition from video using hidden Markov models , 1995 .

[18]  Jae Wook Jeon,et al.  Fingertip detection with morphology and geometric calculation , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Lian-Wen Jin,et al.  An effective robust fingertip detection method for finger writing character recognition system , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[20]  M.K. Bhuyan,et al.  Designing of Human Computer Interactive Platform for Robotic Applications , 2005, TENCON 2005 - 2005 IEEE Region 10 Conference.

[21]  William T. Freeman.  Computer vision for television and games , 1999, Proceedings International Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems. In Conjunction with ICCV'99 (Cat. No.PR00378).

[22]  Xiaobo Ren,et al.  Fingertip detection and tracking using 2D and 3D information , 2008, 2008 7th World Congress on Intelligent Control and Automation.

[23]  Fabio Solari,et al.  A man-machine communication system based on the visual analysis of dynamic gestures , 2005, IEEE International Conference on Image Processing 2005.

[24]  François Bérard,et al.  Bare-hand human-computer interaction , 2001, PUI '01.

[25]  William A. Hoff,et al.  Mobile robot control using a small display , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[26]  Ankit Chaudhary,et al.  A Survey on Hand Gesture Recognition in Context of Soft Computing , 2011 .

[27]  Helge J. Ritter,et al.  Parametrized SOMs for hand posture reconstruction , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[28]  Ali H. Sayed,et al.  SNAP&TELL: a multi-modal wearable computer interface for browsing the environment , 2002, Proceedings. Sixth International Symposium on Wearable Computers,.

[29]  Jong-Min Kim,et al.  Hand Shape Recognition Using Fingertips , 2008, 2008 Fifth International Conference on Fuzzy Systems and Knowledge Discovery.

[30]  Sven Wachsmuth,et al.  View-adaptive manipulative action recognition for robot companions , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[31]  Yoichi Sato,et al.  Real-Time Fingertip Tracking and Gesture Recognition , 2002, IEEE Computer Graphics and Applications.

[32]  Sanjeev Sofat,et al.  Vision Based Hand Gesture Recognition , 2009 .

[33]  Ankit Chaudhary,et al.  An Efficient Real Time Method of Fingertip Detection , 2011, ArXiv.

[34]  Yoichi Sato,et al.  Fast tracking of hands and fingertips in infrared images for augmented desk interface , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[35]  Toyoaki Nishida,et al.  Unsupervised simultaneous learning of gestures, actions and their associations for Human-Robot Interaction , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[36]  Jochen Triesch,et al.  Robotic Gesture Recognition , 1997, Gesture Workshop.

[37]  Yoichi Sato,et al.  Real-time tracking of multiple fingertips and gesture recognition for augmented desk interface systems , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[38]  R. Ishii,et al.  Hand shape extraction from a sequence of digitized gray-scale images , 1994, Proceedings of IECON'94 - 20th Annual Conference of IEEE Industrial Electronics.

[39]  Ying Wu,et al.  VISUAL PANEL: From an ordinary paper to a wireless and mobile input device , 2000 .

[40]  Helge J. Ritter,et al.  Visual recognition of continuous hand postures , 2002, IEEE Trans. Neural Networks.

[41]  V.B. Vats,et al.  A fingertip detection and tracking system as a virtual mouse, a signature input device and an application selector , 2008, IEEE SoutheastCon 2008.