Novel Haar features for real-time hand gesture recognition using SVM

Due to the effect of lighting and complex background, most visual hand gesture recognition systems work only under restricted environments. Here, we propose a robust system which consists of three modules: digital zoom, adaptive skin detection, and hand gesture recognition. The first module detects user face and zooms in so that the face and upper torus take the central part of the image. The second module utilizes the detected user facial color information to detect the other skin color regions like hands. The last module is the most important part for doing both static and dynamic hand gesture recognition. The region of interest next to the detected user face is for fist/waving hand gesture recognition. To classify the dynamic hand gestures under complex background, motion history image and four groups of novel Haar-like features are investigated to classify the dynamic up, down, left, and right hand gestures. A simple efficient algorithm using Support Vector Machine is developed. These defined hand gestures are intuitive and easy for user to control most home appliances. Five users doing 50 dynamic hand gestures at near, medium, and far distances, respectively, were tested under complex environments. Experimental results showed that the accuracy was 95.37 % on average and the processing speed was 3.93 ms per frame. An application integrated with the developed hand gesture recognition was also given to demonstrate the feasibility of proposed system.

[1]  賴一翔,et al.  具搜尋與避障之自動跟隨機器人; The following robot with searching and obstacle-avoiding , 2009 .

[2]  Huei-Yung Lin,et al.  Human computer interaction using face and gesture recognition , 2013, 2013 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference.

[3]  Hui-Zhen Gu,et al.  Integration of Face and Hand Gesture Recognition , 2008, 2008 Third International Conference on Convergence and Hybrid Information Technology.

[4]  Woontack Woo,et al.  ARKB: 3D vision-based Augmented Reality Keyboard , 2003, ICAT.

[5]  Jakub Segen,et al.  Human-computer interaction using gesture recognition and 3D hand tracking , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[6]  Vasile Gui,et al.  Dynamic hand gesture recognition for human-computer interactions , 2011, 2011 6th IEEE International Symposium on Applied Computational Intelligence and Informatics (SACI).

[7]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[8]  Mohammed Yeasin,et al.  Visual understanding of dynamic hand gestures , 2000, Pattern Recognit..

[9]  Yang Liu,et al.  A robust hand tracking and gesture recognition method for wearable visual interfaces and its applications , 2004, Third International Conference on Image and Graphics (ICIG'04).

[10]  Daehee Kim,et al.  Active Shape Model-Based Gait Recognition Using Infrared Images , 2009, FGIT-SIP.

[11]  Lijun Xie,et al.  Visual Mouse: SIFT Detection and PCA Recognition , 2007, 2007 International Conference on Computational Intelligence and Security Workshops (CISW 2007).

[12]  Peter Xiaoping Liu,et al.  Visual gesture recognition for human-machine interface of robot teleoperation , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[13]  L. Van Gool,et al.  Combining RGB and ToF cameras for real-time 3D hand gesture interaction , 2011, 2011 IEEE Workshop on Applications of Computer Vision (WACV).

[14]  Qing Chen,et al.  Hand Gesture Recognition Using Haar-Like Features and a Stochastic Context-Free Grammar , 2008, IEEE Transactions on Instrumentation and Measurement.

[15]  Aditya Ramamoorthy,et al.  Recognition of dynamic hand gestures , 2003, Pattern Recognit..

[16]  Xiang Chen,et al.  Hand as Natural Man-Machine Interface in Smart Environments , 2006, SPPRA.

[17]  Hua Li,et al.  Vision based gesture recognition system with single camera , 2000, WCC 2000 - ICSP 2000. 2000 5th International Conference on Signal Processing Proceedings. 16th World Computer Congress 2000.

[18]  Lars Bretzner,et al.  A Prototype System for Computer Vision Based Human Computer Interaction , 2001 .

[19]  Ingo Steinwart,et al.  Support Vector Machines are Universally Consistent , 2002, J. Complex..

[20]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[21]  Tamás Szirányi,et al.  User-adaptive hand gesture recognition system with interactive training , 2005, Image Vis. Comput..

[22]  Jessie Y. C. Chen,et al.  Human Performance Issues and User Interface Design for Teleoperated Robots , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[23]  Vladimir Vezhnevets,et al.  A Survey on Pixel-Based Skin Color Detection Techniques , 2003 .

[24]  Raúl Rojas,et al.  The Backpropagation Algorithm , 1996 .

[25]  Rainer Lienhart,et al.  An extended set of Haar-like features for rapid object detection , 2002, Proceedings. International Conference on Image Processing.

[26]  Nikos Papamarkos,et al.  Hand gesture recognition using a neural network shape fitting technique , 2009, Eng. Appl. Artif. Intell..

[27]  Manolis I. A. Lourakis,et al.  Vision-Based Interpretation of Hand Gestures for Remote Control of a Computer Mouse , 2006, ECCV Workshop on HCI.

[28]  Dieter Fox,et al.  Adaptive real-time particle filters for robot localization , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).