A Low-Cost Natural User Interaction Based on a Camera Hand-Gestures Recognizer

The search for new simplified interaction techniques is mainly motivated by the improvements of the communication with interactive devices. In this paper, we present an interactive TVs module capable of recognizing human gestures through the PS3Eye low-cost camera. We recognize gestures by the tracking of human skin blobs and analyzing the corresponding movements. It provides means to control a TV in an ubiquitous computing environment. We also present a new free gestures icons library created to allow easy representation and diagramming.

[1]  Richard A. Bolt,et al.  “Put-that-there”: Voice and gesture at the graphics interface , 1980, SIGGRAPH '80.

[2]  Donald A. Norman,et al.  Natural user interfaces are not natural , 2010, INTR.

[3]  Vladimir Pavlovic,et al.  Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  D. McNeill.  Gesture and Thought , 2005 .

[5]  A. Braun,et al.  Symbolic gestures and spoken language are processed by a common neural system , 2009, Proceedings of the National Academy of Sciences.

[6]  Konstantinos G. P. Derpanis,et al.  A Review of Vision-Based Hand Gestures , 2004 .

[7]  Pierre Soille,et al.  Morphological Image Analysis: Principles and Applications , 2003 .

[8]  Oliver Schreer,et al.  Vision-based skin-colour segmentation of moving hands for real-time applications , 2004 .

[9]  Michael Cebulla,et al.  A Framework for Abstract Representation and Recognition of Gestures in Multi-touch Applications , 2010, 2010 Third International Conference on Advances in Computer-Human Interactions.

[10]  Hans-Peter Seidel,et al.  Annotated New Text Engine Animation Animation Lexicon Animation Gesture Profiles MR : . . . JL : . . . Gesture Generation Video Annotated Gesture Script , 2007 .

[11]  Bobby Bodenheimer,et al.  Synthesis and evaluation of linear motion transitions , 2008, TOGS.

[12]  Chun-Jen Chen,et al.  A linear-time component-labeling algorithm using contour tracing technique , 2004, Comput. Vis. Image Underst..

[13]  Sharon L. Oviatt,et al.  Ten myths of multimodal interaction , 1999, Commun. ACM.

[14]  Sharath Pankanti,et al.  Appearance models for occlusion handling , 2006, Image Vis. Comput..