InterActor: Speech-Driven Embodied Interactive Actor

A speech-driven embodied interactive actor called InterActor, with functions of both speaker and listener, was developed for activating human interaction and communication by generating expressive actions and motions coherently related to speech input. InterActor is the electronic media version of a physical interaction robot called InterRobot for robot-mediated communication support, which is free of the hardware restrictions for human interface of advanced graphical user interface based network communication. By using InterActor, the concept of speech-driven embodied interaction system is proposed for human interaction sharing by the entrainment between human speech and InterActor motions in remote communication. The prototype of the system is developed, and the sensory evaluation and behavioral analysis in human communication through InterActor demonstrates the effectiveness of the system. Actual applications of InterActor to human interface are also demonstrated. The system is a practical communication support system, which activates human interaction and communication on the basis of only speech input.

[1]  M. Hirose,et al.  Development and Evaluation of Immersive Multiscreen Display "CABIN" , 1999 .

[2]  Hisato Kobayashi,et al.  A robot listener for fluent verbal communication , 1997, Proceedings 6th IEEE International Workshop on Robot and Human Communication. RO-MAN'97 SENDAI.

[3]  Tmio Watanabe,et al.  A voice reaction system with a visualized response equivalent to nodding , 1989 .

[4]  W. S. Condon,et al.  Neonate Movement Is Synchronized with Adult Speech: Interactional Participation and Language Acquisition , 1974, Science.

[5]  Shigeo Morishima.  Multiple points face-to-face communication in cyberspace using multi-modal agent , 1999, HCI.

[6]  Tomio Watanabe,et al.  An embodied virtual communication system for human interaction sharing , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[7]  Tomio Watanabe,et al.  An Embodied Interaction Robots System Based on Speech , 2000, J. Robotics Mechatronics.

[8]  Tomio Watanabe.  E-COSMIC: embodied communication system for mind connection , 2004, RO-MAN 2004. 13th IEEE International Workshop on Robot and Human Interactive Communication (IEEE Catalog No.04TH8759).

[9]  Tomio Watanabe,et al.  InterRobot: speech-driven embodied interaction robot , 2001, Adv. Robotics.

[10]  Tomio Watanabe,et al.  Quantitative evaluation of infant behaviour and mother–infant interaction: An overview of a japanese interdisciplinary programme of research , 1992 .

[11]  Tomio Watanabe,et al.  Voice-Responsive Eye-Blinking Feedback for Improved Human-to-Machine Speech Input , 1993, HCI.

[12]  Tsutomu Miyasato,et al.  Virtual space teleconferencing "Communication with realistic sensations" , 1995, Proceedings 4th IEEE International Workshop on Robot and Human Communication.

[13]  Carolina Cruz-Neira,et al.  Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the CAVE , 2023 .