Robust hand tracking using a simple color classification technique

Skin color is a strong cue in vision-based human tracking. Skin detection has been widely used in various applications, such as face and hand tracking, people detection in the video databases. In this paper, we propose and develop an effective hand tracking method based on a simple color classification. This method includes two major procedures: training and tracking. In the training procedure, the user specifies a region on a hand to obtain the training data. Based on the skin-color distribution, the training data will be classified into several color clusters using randomized list data structure. In the hand tracking procedure, the hand will be segmented in real-time from the background using the randomized lists that have been trained in the training procedure. The proposed method has two advantages: (1) It is fast because the image segmentation algorithm is automatically performed on a small region surrounding the hand; and (2) It is robust under different lighting conditions because the lighting factor is not employed in our effective color classification. Several experiments have been conducted to validate the performance of the proposed method. This proposed method has good potential in many real applications, such as virtual reality or augmented reality systems.

[1]  Richard Bowden,et al.  A boosted classifier tree for hand shape detection , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[2]  Ying Wu,et al.  An Adaptive Self-Organizing Color Segmentation Algorithm with Application to Robust Real-time Human Hand Localization , 2000 .

[3]  Marcelo Knörich Zuffo,et al.  On the usability of gesture interfaces in virtual reality environments , 2005, CLIHC '05.

[4]  Stan Sclaroff,et al.  Skin color-based video segmentation under time-varying illumination , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  James M. Rehg,et al.  Statistical Color Models with Application to Skin Detection , 2004, International Journal of Computer Vision.

[6]  Dorin Comaniciu,et al.  Real-time tracking of non-rigid objects using mean shift , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[7]  John R. Kender,et al.  Finding skin in color images , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[8]  Gary Bradski,et al.  Computer Vision Face Tracking For Use in a Perceptual User Interface , 1998 .

[9]  Ying Wu,et al.  Color tracking by transductive learning , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[10]  Ming Xie,et al.  Hand image segmentation using color and RCE neural network , 2001, Robotics Auton. Syst..

[11]  Rainer Stiefelhagen,et al.  Pointing gesture recognition based on 3D-tracking of face, hands and head orientation , 2003, ICMI '03.

[12]  Miaolong Yuan,et al.  Robust hand tracking using a skin tone and depth joint probability model , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[13]  Alexander H. Waibel,et al.  Segmenting hands of arbitrary color , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[14]  Shaogang Gong,et al.  Colour Model Selection and Adaption in Dynamic Scenes , 1998, ECCV.

[15]  Ying Wu,et al.  Visual panel: virtual mouse, keyboard and 3D controller with an ordinary piece of paper , 2001, PUI '01.