Evaluation of Hand Pointing System Based on 3-D Computer Vision

Evaluation of hand pointing system is presented. The system is based on 3D computer vision and implemented using open source computer vision library (OpenCV). The system is able to detect and track user’s head and hand and return 3D coordinates in real time. The detection of head and hand is based on Viola-Jones detector applying human skin color model information. The detection rate is about 90%. The tracking is based on Kanade-Lucas-Tomasi iterative algorithm, customized for 3D computer vision case. High tracking robustness (90%) is achieved due to skin color model and variable size search window according to depth information. The speed of the system is 15–23 frames per second on 3 GHz desktop PC. Ill. 3, bibl. 11 (in English; summaries in English, Russian and Lithuanian).

[1]  Mathias Kölsch,et al.  Robust hand detection , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[2]  ius,et al.  Detection of Hand Position using 3-D Computer Vision , 2006 .

[3]  Mathias Kölsch,et al.  Analysis of rotational robustness of hand detection with a Viola-Jones detector , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[4]  Alex Pentland,et al.  Pfinder: Real-Time Tracking of the Human Body , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  P. Serafinavičius.  Estimating Characteristic Points of Human Body for Automatic Hand Pointing Gesture Recognition , 2007 .

[6]  Mathias Kölsch,et al.  Fast 2D Hand Tracking with Flocks of Features and Multi-Cue Integration , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[7]  James M. Rehg,et al.  Statistical Color Models with Application to Skin Detection , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[8]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[9]  Trevor Darrell,et al.  Integrated Person Tracking Using Stereo, Color, and Pattern Detection , 2000, International Journal of Computer Vision.

[10]  P. Serafinavičius,et al.  Detection of Hand Position using 3-D Computer Vision , 2006 .

[11]  Terrence Fong,et al.  Vision-based sensor fusion for human-computer interaction , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .