A Real Time Vision-Based Hand Gesture Interaction

Moving beyond mouse and keyboard, the evolution of human-computer interaction (HCI) has been an interest research in recent years which witnessed the development from text-based like using a keyboard to graphic user interface (GUI) based on a mouse, from cumbersome data gloves and tracking devices to visual-based computer application. One of the interest fields is by using hand gestures to interact with computer. However, the complexity of a hand set a lot of challenges to be tracked. In real-time, the application requires high accurate detection and recognition. In additional the real and clutter environments have a big impact on recognition process because it included with irrelevant information from the application point of view. In this paper, a real time vision based hand gesture interaction prototype was proposed. Currently a prototype has built for controlling the desktop cursor and concerned the tasks involving in navigation the desktop cursor by using hand gesture input modality

[1]  Sébastien Marcel,et al.  Hand gesture recognition using input-output hidden Markov models , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[2]  Thomas B. Moeslund,et al.  A brief overview of hand gestures used in wearable human computer interfaces , 2003 .

[3]  Dimitrios Tzovaras.  Multimodal User Interfaces , 2008 .

[4]  Chung-Lin Huang,et al.  Hand gesture recognition using a real-time tracking method and hidden Markov models , 2003, Image Vis. Comput..

[5]  Jurij F. Tasic,et al.  Vision-based human-computer interface using hand gestures , 2007, Eighth International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS '07).

[6]  Mario Aguilar,et al.  Facilitating User Interaction with Complex Systems via Hand Gesture Recognition , 2003 .

[7]  Qing Chen,et al.  Human - Computer interaction for smart environment applications using hand gestures and facial expressions , 2009, Int. J. Adv. Media Commun..

[8]  Mathias Kölsch,et al.  Analysis of rotational robustness of hand detection with a Viola-Jones detector , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[9]  Manolis I. A. Lourakis,et al.  Vision-Based Interpretation of Hand Gestures for Remote Control of a Computer Mouse , 2006, ECCV Workshop on HCI.

[10]  Ying Wu,et al.  Vision-Based Gesture Recognition: A Review , 1999, Gesture Workshop.

[11]  Fang Chen.  Designing Human Interface in Speech Technology, Kluwer Academic Publishers , 2005 .

[12]  Philip Kortum,et al.  HCI Beyond the GUI: Design for Haptic, Speech, Olfactory, and Other Nontraditional Interfaces , 2008 .

[13]  Gary R. Bradski,et al.  Learning OpenCV - computer vision with the OpenCV library: software that sees , 2008 .

[14]  Ralf Salomon,et al.  Gesture recognition for virtual reality applications using data gloves and neural networks , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[15]  Modesto Castrillón Santana,et al.  Hand Pose Detection for Vision-based Gesture Interfaces , 2005, MVA.

[16]  Jaron Lanier,et al.  A hand gesture interface device , 1987, CHI 1987.

[17]  Jiajun Wen,et al.  Vision-based two hand detection and tracking , 2009, ICIS '09.

[18]  N.D. Georganas,et al.  Real-time Vision-based Hand Gesture Recognition Using Haar-like Features , 2007, 2007 IEEE Instrumentation & Measurement Technology Conference IMTC 2007.

[19]  Fan Chen,et al.  Hand Gesture Detection and Segmentation Based on Difference Background Image with Complex Background , 2008, 2008 International Conference on Embedded Software and Systems.

[20]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[21]  Lale Akarun,et al.  Sign Language Tutoring tool , 2005, 2005 13th European Signal Processing Conference.

[22]  Dimitrios Tzovaras.  Multimodal user interfaces : from signals to interaction , 2008 .

[23]  Lars Bretzner,et al.  Computer Vision Based Hand Gesture Interfaces for Human-Computer Interaction , 2002 .

[24]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .

[25]  N.A. Ismail,et al.  Enabling multimodal interaction in web-based personal digital photo browsing , 2008, 2008 International Conference on Computer and Communication Engineering.

[26]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[27]  Fang Chen,et al.  Designing Human Interface in Speech Technology , 2005 .

[28]  Mathias Kölsch,et al.  Robust hand detection , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..