Handy: A real-time three color glove-based gesture recognizer with learning vector quantization

This paper presents Handy, a real-time hand gesture recognizer based on a three color glove. The recognizer is formed by three modules. The first module, fed by the frame acquired by a webcam, identifies the hand image in the scene. The second module, a feature extractor, represents the image by a nine-dimensional feature vector. The third module, the classifier, is performed by means of learning vector quantization. The recognizer, tested on a dataset of 907 hand gestures, has shown very high recognition rate.

[1]  Wu-Chih Hu,et al.  Gabor filter-based hand-pose angle estimation for hand gesture recognition under varying illumination , 2011, Expert Syst. Appl..

[2]  Jovan Popovic,et al.  Real-time hand-tracking with a color glove , 2009, SIGGRAPH '09.

[3]  M. Stone Cross‐Validatory Choice and Assessment of Statistical Predictions , 1976 .

[4]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[5]  Francesco Camastra,et al.  Cursive character recognition by learning vector quantization , 2001, Pattern Recognit. Lett..

[6]  Tin Kam Ho,et al.  Recognition of handwritten digits by combining independent learning vector quantizations , 1993, Proceedings of 2nd International Conference on Document Analysis and Recognition (ICDAR '93).

[7]  M. Stone,et al.  Cross‐Validatory Choice and Assessment of Statistical Predictions , 1976 .

[8]  W. Chase,et al.  Visual information processing. , 1974 .

[9]  Mohammed Bahoura,et al.  Automatic recognition of fin and blue whale calls for real-time monitoring in the St. Lawrence. , 2009, The Journal of the Acoustical Society of America.

[10]  Eric R. Ziegel,et al.  The Elements of Statistical Learning , 2003, Technometrics.

[11]  Jorma Laaksonen,et al.  LVQ_PAK: The Learning Vector Quantization Program Package , 1996 .

[12]  Koby Crammer,et al.  Margin Analysis of the LVQ Algorithm , 2002, NIPS.

[13]  Christopher K. I. Williams Learning Kernel Classifiers , 2003 .

[14]  Ankit Chaudhary,et al.  A Survey on Hand Gesture Recognition in Context of Soft Computing , 2011 .

[15]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[16]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[17]  Jing Li Wang,et al.  Color image segmentation: advances and prospects , 2001, Pattern Recognit..

[18]  Alex Zelinsky,et al.  Learning OpenCV---Computer Vision with the OpenCV Library (Bradski, G.R. et al.; 2008)[On the Shelf] , 2009, IEEE Robotics & Automation Magazine.

[19]  Philippe Coiffet,et al.  Virtual Reality Technology , 2003, Presence: Teleoperators & Virtual Environments.

[20]  M. V. Velzen,et al.  Self-organizing maps , 2007 .

[21]  Achilleas Zapranis,et al.  Identification of the Head-and-Shoulders Technical Analysis Pattern with Neural Networks , 2010, ICANN.

[22]  Teuvo Kohonen,et al.  Learning vector quantization , 1998 .

[23]  F. O. Huck,et al.  Visual Information Processing , 1992 .

[24]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[25]  Patrycja Ciosek,et al.  The analysis of sensor array data with various pattern recognition techniques , 2006 .

[26]  Hui Deng,et al.  A Survey on Hand Gesture Recognition , 2013, 2013 International Conference on Computer Sciences and Applications.

[27]  Yu Ren,et al.  Real-Time Hand Gesture Recognition Based on Vision , 2010, Edutainment.

[28]  David G. Stork,et al.  Pattern Classification , 1973 .

[29]  Alexander J. Smola,et al.  Learning with kernels , 1998 .

[30]  Adam Kendon,et al.  How gestures can become like words , 1988 .

[31]  Neff Walker,et al.  Evaluation of the CyberGlove as a whole-hand input device , 1995, TCHI.

[32]  Nello Cristianini,et al.  Kernel Methods for Pattern Analysis , 2004 .

[33]  Yung-Hui Lee,et al.  The parameters effect on performance in ANN for hand gesture recognition system , 2011, Expert Syst. Appl..

[34]  Paolo Dario,et al.  A Survey of Glove-Based Systems and Their Applications , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[35]  Tapio Frantti,et al.  Expert system for gesture recognition in terminal's user interface , 2004, Expert Syst. Appl..