Real-time vision pointer interface

This paper presents a new solution for human-computer interaction that utilizes hand gestures for intuitive operation without any devices restraining the hand freedom. The proposed system is able to completely replace a mouse as a pointing device. Moreover, it extends mouse capabilities by a set of hand gestures. The system is a vision-based interface, and a simple webcam is sufficient for proper operation. The article reveals concepts and algorithms used for construction of the system, which provide fast calculations and high performance using typical hardware.

[1]  Ioannis Pitas,et al.  Facial feature extraction in frontal views using biometric analogies , 1998, 9th European Signal Processing Conference (EUSIPCO 1998).

[2]  Michal Kawulok,et al.  Energy-based blob analysis for improving precision of skin segmentation , 2010, Multimedia Tools and Applications.

[3]  Nikolaos G. Bourbakis,et al.  A survey of skin-color modeling and detection methods , 2007, Pattern Recognit..

[4]  Yoichi Sato,et al.  Real-Time Fingertip Tracking and Gesture Recognition , 2002, IEEE Computer Graphics and Applications.

[5]  Cristina Manresa-Yee,et al.  Hand Tracking and Gesture Recognition for Human-Computer Interaction , 2009, Progress in Computer Vision and Image Analysis.

[6]  A. Al-Hamadi,et al.  Gesture Recognition for Alphabets from Hand Motion Trajectory Using Hidden Markov Models , 2007, 2007 IEEE International Symposium on Signal Processing and Information Technology.

[7]  R. Herpers,et al.  Fast hand gesture recognition for real-time teleconferencing applications , 2001, Proceedings IEEE ICCV Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems.

[8]  Makoto Mizukawa,et al.  Fast Hand Feature Extraction Based on Connected Component Labeling, Distance Transform and Hough Transform , 2009, J. Robotics Mechatronics.

[9]  James M. Rehg,et al.  Statistical Color Models with Application to Skin Detection , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[10]  Narendra Ahuja,et al.  Gaussian mixture model for human skin color and its applications in image and video databases , 1998, Electronic Imaging.

[11]  Wei-Yang Lin,et al.  Trajectory-based sign language recognition using Discriminant Analysis in higher-dimensional feature space , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[12]  Kongqiao Wang,et al.  A Framework for Hand Gesture Recognition Based on Accelerometer and EMG Sensors , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[13]  Edward Cutrell,et al.  FlowMouse: A Computer Vision-Based Pointing and Gesture Input Device , 2005, INTERACT.

[14]  P. Peer,et al.  Human skin color clustering for face detection , 2003, The IEEE Region 8 EUROCON 2003. Computer as a Tool..

[15]  M.K. Bhuyan,et al.  Feature Extraction from 2D Gesture Trajectory in Dynamic Hand Gesture Recognition , 2006, 2006 IEEE Conference on Cybernetics and Intelligent Systems.

[16]  Alessandro Zimmer,et al.  Hand geometry: a new approach for feature extraction , 2005, Fourth IEEE Workshop on Automatic Identification Advanced Technologies (AutoID'05).

[17]  Chengdong Wu,et al.  Hand extraction using geometric moments based on active skin color model , 2009, 2009 IEEE International Conference on Intelligent Computing and Intelligent Systems.