A virtual space teleconferencing system that supports intuitive interaction for creative and cooperative work

Since their advent, interaction with computers has been a very fascinating field of research. Though, we have come a long way from turning knobs and punching cards to using keyboards and pointing devices, natural language interaction has not seen widespread use as a general means of interaction. The thesis of this paper is that some application fields, specially those dealing with computer graphics, can benefit from the interaction of natural language and hand gestures. This bimodal means of interaction in computer-graphics-based task, complements the deficiencies of just applying either one of the two modes. This paper, describes current research efforts taking place at ATR for combining hand gestures and verbal descriptions for generating, modifying and manipulating 3D computer graphics objects.

[1]  S. Kicha Ganapathy,et al.  A synthetic visual environment with hand gesturing and voice input , 1989, CHI '89.

[2]  Kenji Kita,et al.  ATREUS: a speech recognition front-end for a speech translation system , 1993, EUROSPEECH.

[3]  M. Wertheimer.  Laws of organization in perceptual forms. , 1938 .

[4]  Dimitris N. Metaxas,et al.  Dynamic 3D Models with Local and Global Deformations: Deformable Superquadrics , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Fumio Kishino,et al.  Real time hand gesture recognition using 3D prediction model , 1993, Proceedings of IEEE Systems Man and Cybernetics Conference - SMC.

[6]  E. Rosch.  ON THE INTERNAL STRUCTURE OF PERCEPTUAL AND SEMANTIC CATEGORIES1 , 1973 .

[7]  H. Keith Nishihara,et al.  Intensity, Visible-Surface, and Volumetric Representations , 1981, Artif. Intell..

[8]  E. J. Altman,et al.  Normal form analysis of Chua's circuit with applications for trajectory recognition , 1993 .

[9]  Fumio Kishino,et al.  Interactive 3-D computer graphics driven through verbal instructions: Previous and current activities at ART , 1994, Comput. Graph..

[10]  Fumio Kishino,et al.  Object manipulation and layout in a 3D virtual space using a combination of natural language and hand pointing , 1992, Other Conferences.

[11]  Yoshifumi Kitamura,et al.  A simple and efficient method for accurate collision detection among deformable polyhedral objects in arbitrary motion , 1995, Proceedings Virtual Reality Annual International Symposium '95.

[12]  Fumio Kishino,et al.  Real-time reproduction of 3D human images in virtual space teleconferencing , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[13]  P. Stevens.  Patterns in Nature , 1974 .