An Automatic Hand Gesture Recognition System Based on Viola-Jones Method and SVMs

In this paper we present an automatic hand gesture recognition system operating on video stream. The system consists of two modules: hand gesture detection module and hand gesture recognition module. The detection module could accurately locate the hand regions with a blue rectangle; this is mainly based on Viola-Jones method, which is currently considered the fastest and most accurate learning-based method for object detection. In the recognition module, the Hu invariant moments feature vectors of the detected hand gesture are extracted and a Support Vector Machines (SVMs) classifier is trained for final recognition, due to its high generalization performance without the need to add a priori knowledge. The performance of the proposed system is tested through a series of experiments and a simple Human-Computer Interaction application based on hand gesture recognition method is finally developed.

[1]  S. Maitra Moment invariants , 1979, Proceedings of the IEEE.

[2]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[3]  Robert B. McGhee,et al.  Aircraft Identification by Moment Invariants , 1977, IEEE Transactions on Computers.

[4]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[5]  N.D. Georganas,et al.  Real-time Vision-based Hand Gesture Recognition Using Haar-like Features , 2007, 2007 IEEE Instrumentation & Measurement Technology Conference IMTC 2007.

[6]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[7]  Alex Pentland,et al.  A Wearable Computer Based American Sign Language Recognizer , 1997, SEMWEB.

[8]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .

[9]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[10]  Purdy Ho,et al.  Rotation Invariant Real-time Face Detection and Recognition System , 2001 .

[11]  Paul A. Viola,et al.  Fast Multi-view Face Detection , 2003 .