Wrist Localization in Color Images for Hand Gesture Recognition

In this paper we present an extensive study of a two-stage algorithm for wrist localization in color images, which is an important and challenging, yet not extensively studied, step in gesture recognition systems. In the first stage of the algorithm, a color hand image is subject to skin segmentation. Secondly, the wrist is localized in a corresponding binarized skin probability map. In our two-stage approach, the algorithms for both localization stages can be developed and compared separately. Here, we compare our propagation-based skin segmentation algorithm and real-time wrist localization algorithm with other state-of-the-art approaches based on our set of 414 color hand images using two independent sets of ground-truth data.

[1]  Hyunchul Shin,et al.  New hand gesture recognition method for mouse operations , 2011, 2011 IEEE 54th International Midwest Symposium on Circuits and Systems (MWSCAS).

[2]  Soh-Khim Ong,et al.  Vision-Based Hand Interaction in Augmented Reality Environment , 2011, Int. J. Hum. Comput. Interact..

[3]  Bernt Schiele,et al.  Skin Patch Detection in Real-World Images , 2002, DAGM-Symposium.

[4]  Alaa Y. Taqa,et al.  Increasing the reliability of skin detectors , 2010 .

[5]  Marek Kurzynski,et al.  Proceedings of the 8th International Conference on Computer Recognition Systems CORES 2013, Milkow, Poland, 27-29 May 2013 , 2013, CORES.

[6]  Rajkumar Roy,et al.  Applications of Soft Computing , 2009 .

[7]  Shaun J. Canavan,et al.  Hand Pointing Estimation for Human Computer Interaction Based on Two Orthogonal-Views , 2010, 2010 20th International Conference on Pattern Recognition.

[8]  Hélène Laurent,et al.  Hand-gesture recognition: Comparative study of global, semi-local and local approaches , 2011, 2011 7th International Symposium on Image and Signal Processing and Analysis (ISPA).

[9]  Kwang-Seok Hong,et al.  Game interface using hand gesture recognition , 2010, 5th International Conference on Computer Sciences and Convergence Information Technology.

[10]  Michal Kawulok,et al.  Fast propagation-based skin regions segmentation in color images , 2013, 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[11]  Jakub Nalepa,et al.  Skin Detection and Segmentation in Color Images , 2014 .

[12]  M. Kawulok,et al.  Real-time vision pointer interface , 2012, Proceedings ELMAR-2012.

[13]  Tamás Szirányi,et al.  Hand Gesture Recognition in Camera-Projector System , 2004, ECCV Workshop on HCI.

[14]  Nicu Sebe,et al.  Computer Vision in Human-Computer Interaction , 2004, Lecture Notes in Computer Science.

[15]  Yu Huang,et al.  A Concept Grounding Approach for Glove-Based Gesture Recognition , 2011, 2011 Seventh International Conference on Intelligent Environments.

[16]  Hung-Ming Sun,et al.  Skin detection for single images using dynamic skin color modeling , 2010, Pattern Recognit..

[17]  James M. Rehg,et al.  Statistical Color Models with Application to Skin Detection , 2004, International Journal of Computer Vision.

[18]  Yael Edan,et al.  A Real-Time Hand Gesture Interface for Medical Visualization Applications , 2006 .

[19]  Jakub Nalepa,et al.  Real-Time Wrist Localization in Hand Silhouettes , 2013, CORES.