Analysis of the Hand Motion Trajectories for Recognition of Air-Drawn Symbols

This paper presents a framework to recognize the symbols drawn in air using bare hand motion. The work marks a step towards development of non-tactile interfaces requiring no physical means for writing or drawing. To overcome the limitations of traditional two dimensional camera based acquisition, a preliminary step in gesture recognition, depth based sensor is used to acquire trajectory signals. In place of DTW (Dynamic Time Warp) and HMM (Hidden Markov Model) a non-time-warping approach is adopted in this work to recognize trajectories. Start and end delimitation of character trajectory drawing is established through finger detection based control gestures. Three simple features are evaluated by rule based and distance based classification, and classifier votes determine the recognition decision. Recognition accuracy up to 96% is achieved.

[1]  Chung-Lin Huang,et al.  Hand gesture recognition using a real-time tracking method and hidden Markov models , 2003, Image Vis. Comput..

[2]  Dipak Kumar Ghosh,et al.  A static hand gesture recognition algorithm using k-mean based radial basis function neural network , 2011, 2011 8th International Conference on Information, Communications & Signal Processing.

[3]  Vladimir Pavlovic,et al.  Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  H. Matsumoto,et al.  Hand Region Extraction by Background Subtraction with Renewable Background for Hand Gesture Recognition , 2006, 2006 International Symposium on Intelligent Signal Processing and Communications.

[5]  Helman Stern,et al.  Most discriminating segment - Longest common subsequence (MDSLCS) algorithm for dynamic hand gesture classification , 2013, Pattern Recognit. Lett..

[6]  Aditya Ramamoorthy,et al.  Recognition of dynamic hand gestures , 2003, Pattern Recognit..

[7]  Mircea Nicolescu,et al.  Vision-based hand pose estimation: A review , 2007, Comput. Vis. Image Underst..

[8]  Ho-Sub Yoon,et al.  Gesture-based editing system for graphic primitives and alphanumeric characters , 1999 .

[9]  Prabin Kumar Bora,et al.  Trajectory Guided Recognition of Hand Gestures having only Global Motions , 2008 .

[10]  Adrian Hilton,et al.  A survey of advances in vision-based human motion capture and analysis , 2006, Comput. Vis. Image Underst..

[11]  Toshiaki Kondo,et al.  A simple shape-based approach to hand gesture recognition , 2010, ECTI-CON2010: The 2010 ECTI International Confernce on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology.

[12]  Yi Li,et al.  Dynamic hand gesture recognition using hidden Markov models , 2012, 2012 7th International Conference on Computer Science & Education (ICCSE).

[13]  Sang-Heon Lee,et al.  A comparison of 3D hand gesture recognition using dynamic time warping , 2012, IVCNZ '12.

[14]  Stan Sclaroff,et al.  Translation and scale-invariant gesture recognition in complex scenes , 2008, PETRA '08.

[15]  Vassilis Athitsos,et al.  Comparing gesture recognition accuracy using color and depth information , 2011, PETRA '11.

[16]  Du-Ming Tsai,et al.  Object recognition by a linear weight classifier , 1995, Pattern Recognit. Lett..