An Embodied Communication System with Speech-Driven Embodied Entraimment Characters and Force Sensor Input

In human face-to-face communication, both verbal and nonverbal communication such as nodding and body motions are rhythmically related and mutually synchronized between talkers. This synchrony of embodied rhythms generates the sharing of embodiment in human interaction, which plays an important role in essential human interaction and communication. Further, humans make also body actions which express their intention. These nodding and body actions realize smooth and natural human communication. In this paper, we develop an embodied communication system which is composed of speech-driven embodied entrainment characters InterActors and a force sensor. In this communication system, InterActor makes body actions which express intention of affirmation and negation by force sensor inputs as well as entrained body motions by speech input. The effectiveness of the proposed communication system is demonstrated by sensory evaluations.