Hand Gesture Modeling, Analysis, and Synthesis

Hand gestures are a form of communication among people. Yet we still limit human-computer interaction to cumbersome mice movements. The use of hand gestures in the eld of human-computer interaction has attracted new interest in the past several years. Special glove-based devices have been developed to analyze nger and hand motion and use them to manipulate and explore virtual worlds. To further enrich the naturalness of the interaction, different computer vision-based techniques have been brought into use. At the same time the need for more eecient systems has resulted in new gesture modeling approaches. In this paper we present a review of the most recent work related to hand gesture modeling, analysis and synthesis. We describe four major classes of hand gesture interface techniques: glove-based techniques, vision-based techniques , techniques that use drawing gestures, and other gesture analysis techniques. A brief description of more than thirty gesture-interface systems is presented with special attention focused on the systems that use computer vision techniques.

[1]  Richard Furuta,et al.  The virtual panel architecture: A 3D gesture framework , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[2]  Thad Starner,et al.  Visual Recognition of American Sign Language Using Hidden Markov Models. , 1995 .

[3]  A. Torige,et al.  Human-interface by recognition of human gesture with image processing-recognition of gesture to specify moving direction , 1992, [1992] Proceedings IEEE International Workshop on Robot and Human Communication.

[4]  Dean Rubine,et al.  Combining gestures and direct manipulation , 1992, CHI.

[5]  James W. Davis,et al.  Determining 3-D hand motion , 1994, Proceedings of 1994 28th Asilomar Conference on Signals, Systems and Computers.

[6]  Myron W. Krueger.  Environmental technology: making the real world virtual , 1993, CACM.

[7]  José Teixeira,et al.  Advanced interaction techniques in virtual environments , 1993, Comput. Graph..

[8]  Daniel Thalmann,et al.  Simulation of object and human skin formations in a grasping task , 1989, SIGGRAPH.

[9]  Christoph Maggioni,et al.  A novel gestural input device for virtual reality , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[10]  Daniel Thalmann,et al.  A Hand Control and Automatic Grasping System for Synthetic Actors , 1994, Comput. Graph. Forum.

[11]  Daniel Thalmann,et al.  Computer animation - theory and practice , 1985, Computer science workbench.

[12]  R. B. Knapp,et al.  Real-time computer control using pattern recognition of the electromyogram , 1993, Proceedings of the 15th Annual International Conference of the IEEE Engineering in Medicine and Biology Societ.

[13]  Geoffrey E. Hinton,et al.  Glove-Talk: a neural network interface between a data-glove and a speech synthesizer , 1993, IEEE Trans. Neural Networks.

[14]  John C. Tang,et al.  Videodraw: a video interface for collaborative drawing , 1991, TOIS.

[15]  Amane Nakajima,et al.  A Two-Way Dual-View Teleteaching System Conveying Gestures and Chalkboard Contents (Special Issue on Networked Reality) , 1994 .

[16]  Yangsheng Xu,et al.  Gesture interface: modeling and learning , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[17]  Fumio Kishino,et al.  Stereo-based description by generalized cylinder complexes from occluding contours , 1991, Systems and Computers in Japan.

[18]  David Zeltzer,et al.  A survey of glove-based input , 1994, IEEE Computer Graphics and Applications.

[19]  Jonathan Grudin,et al.  Integration of interpersonal space and shared workspace: ClearBoard design and experiments , 1993, TOIS.

[20]  Bernd Fröhlich,et al.  The Responsive Workbench [virtual work environment] , 1994, IEEE Computer Graphics and Applications.

[21]  S. Ahmad,et al.  A usable real-time 3D hand tracker , 1994, Proceedings of 1994 28th Asilomar Conference on Signals, Systems and Computers.

[22]  Daniel Thalmann,et al.  Joint-dependent local deformations for hand animation and object grasping , 1989 .

[23]  Edward Hunter,et al.  Vision based hand gesture interpretation using recursive estimation , 1994, Proceedings of 1994 28th Asilomar Conference on Signals, Systems and Computers.

[24]  William T. Freeman,et al.  Orientation Histograms for Hand Gesture Recognition , 1995 .

[25]  Alex Pentland,et al.  Space-time gestures , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Philippe Quéau.  Televirtuality: The merging of telecommunications and virtual reality , 1993, Comput. Graph..

[27]  D. L. Quam,et al.  Gesture recognition with a DataGlove , 1990, IEEE Conference on Aerospace and Electronics.

[28]  Stanley M. Dunn,et al.  Learning Shape Classes , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Takeo Kanade,et al.  DigitEyes: Vision-Based Human Hand Tracking , 1993 .

[30]  Francis K. H. Quek,et al.  Toward a vision-based hand gesture interface , 1994 .

[31]  Thomas S. Huang,et al.  Vision based hand modeling and tracking for virtual teleconferencing and telecollaboration , 1995, Proceedings of IEEE International Conference on Computer Vision.

[32]  Greg Turk,et al.  Interactive simulation in a multi-person virtual world , 1992, CHI.

[33]  Collin Wang,et al.  A virtual end-effector pointing system in point-and-direct robotics for inspection of surface flaws using a neural network based skeleton transform , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[34]  A. Lecours,et al.  The Biological foundations of gestures : motor and semiotic aspects , 1986 .

[35]  Steven D. Pieper,et al.  Hands-on interaction with virtual environments , 1989, UIST '89.

[36]  Yasuhito Suenaga,et al.  "Finger-Pointer": Pointing interface by image processing , 1994, Comput. Graph..

[37]  Volker Tresp,et al.  Classification with missing and uncertain inputs , 1993, IEEE International Conference on Neural Networks.

[38]  Roberto Cipolla,et al.  Robust structure from motion using motion parallax , 1993, 1993 (4th) International Conference on Computer Vision.

[39]  Michel Beaudouin-Lafon,et al.  Charade: remote control of objects using free-hand gestures , 1993, CACM.

[40]  Dean Rubine.  Integrating Gesture Recognition and Direct Manipulation , 1991, USENIX Summer.

[41]  Tosiyasu L. Kunii,et al.  Constraint-Based Hand Animation , 1993 .