Combining Skin Color and Optical Flow for Computer Vision Systems

Skin color is an important visual cue for computer vision systems involving human users. In this paper we combine skin color and optical flow for detection and tracking of skin regions. We apply these techniques to gesture recognition with encouraging results. We propose a novel skin similarity measure. For grouping detected skin regions we propose a novel skin region grouping mechanism. The proposed techniques work with any number of skin regions making them suitable for a multiuser scenario. Keywords— Bayesian tracking, chromaticity space, optical flow gesture recognition

[1]  Ying Wu,et al.  Vision-Based Gesture Recognition: A Review , 1999, Gesture Workshop.

[2]  Alberto Del Bimbo,et al.  Multi-User Natural Interaction System based on Real-Time Hand Tracking and Gesture Recognition , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[3]  Zhan Song,et al.  Hand Detection and Gesture Recognition Exploit Motion Times Image in Complicate Scenarios , 2010, ISVC.

[4]  H. Ney,et al.  Modeling Image Variability in Appearance-Based Gesture Recognition , 2006 .

[5]  E. Granum,et al.  Skin colour detection under changing lighting conditions , 1999 .

[6]  Mika Laaksonen,et al.  Adaptive skin color modeling using the skin locus for selecting training pixels , 2003, Pattern Recognit..

[7]  Esther Koller-Meier,et al.  Tracking multiple objects using the Condensation algorithm , 2001, Robotics Auton. Syst..

[8]  George Awad,et al.  Real Time Hand Gesture Recognition Including Hand Segmentation and Tracking , 2006, ISVC.

[9]  Stan Sclaroff,et al.  Skin color-based video segmentation under time-varying illumination , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Manolis I. A. Lourakis,et al.  Real-Time Tracking of Multiple Skin-Colored Objects with a Possibly Moving Camera , 2004, ECCV.

[11]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[12]  Michael J. Black,et al.  Secrets of optical flow estimation and their principles , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[14]  Chih-Jen Lin,et al.  A Practical Guide to Support Vector Classication , 2008 .

[15]  Tim Morris,et al.  Skin Locus Based Skin Detection for Gesture Recognition , 2010, BMVC 2010.

[16]  Gihan Shin,et al.  Vision-Based Multimodal Human Computer Interface Based on Parallel Tracking of Eye and Hand Motion , 2007, 2007 International Conference on Convergence Information Technology (ICCIT 2007).

[17]  Arthur Gelb,et al.  Applied Optimal Estimation , 1974 .

[18]  Michael J. Black,et al.  A Probabilistic Framework for Matching Temporal Trajectories: CONDENSATION-Based Recognition of Gestures and Expressions , 1998, ECCV.

[19]  Ying Yin,et al.  Toward natural interaction in the real world: real-time gesture recognition , 2010, ICMI-MLMI '10.