Expression transmission using exaggerated animation for Elfoid

We propose an expression transmission system using a cellular-phone-type teleoperated robot called Elfoid. Elfoid has a soft exterior that provides the look and feel of human skin, and is designed to transmit the speaker's presence to their communication partner using a camera and microphone. To transmit the speaker's presence, Elfoid sends not only the voice of the speaker but also the facial expression captured by the camera. In this research, facial expressions are recognized using a machine learning technique. Elfoid cannot, however, display facial expressions because of its compactness and a lack of sufficiently small actuator motors. To overcome this problem, facial expressions are displayed using Elfoid's head-mounted mobile projector. In an experiment, we built a prototype system and experimentally evaluated it's subjective usability.

[1]  Kazuaki Tanaka,et al.  Physical Embodiment Can Produce Robot Operator’s Pseudo Presence , 2015, Front. ICT.

[2]  K. Nakadai,et al.  Effect of facial colors on humanoids in emotion recognition using speech , 2004, RO-MAN 2004. 13th IEEE International Workshop on Robot and Human Interactive Communication (IEEE Catalog No.04TH8759).

[3]  Kosuke Sato,et al.  Construction of an interpersonal interaction system using a real image-based avatar , 2014 .

[4]  Shigeki Sugano,et al.  Emergence of mind in robots for human interface - research methodology and robot model , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[5]  Matsuda Masafumi,et al.  An exploratory experimental study on determinants of interpersonal impression among video communication users -- Comparison of the video and audio stimuli , 2012 .

[6]  H. Ishiguro,et al.  EXPLORING THE UNCANNY VALLEY WITH GEMINOID HI-1 IN A REAL-WORLD APPLICATION , 2010 .

[7]  Young-Koo Lee,et al.  Hierarchical Recognition Scheme for Human Facial Expression Recognition Systems , 2013, Sensors.

[8]  S. Demleitner.  [Communication without words]. , 1997, Pflege aktuell.

[9]  Tetsuo Ono,et al.  Android as a telecommunication medium with a human-like presence , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[10]  Simon Lucey,et al.  Deformable Model Fitting by Regularized Landmark Mean-Shift , 2010, International Journal of Computer Vision.

[11]  F. Thomas,et al.  The illusion of life : Disney animation , 1981 .

[12]  H. Bülthoff,et al.  The contribution of different facial regions to the recognition of conversational expressions. , 2008, Journal of vision.

[13]  Karen L. Schmidt,et al.  Human facial expressions as adaptations: Evolutionary questions in facial expression research. , 2001, American journal of physical anthropology.

[14]  J. Prinz.  Which Emotions Are Basic , 2007 .

[15]  Wijnand A. IJsselsteijn,et al.  Machines Outperform Laypersons in Recognizing Emotions Elicited by Autobiographical Recollection , 2013, Hum. Comput. Interact..

[16]  Ken Fujiwara,et al.  The function of positive affect in a communication context : Satisfaction with conversation and hand movement , 2010 .

[17]  K. Fujii,et al.  Visualization for the analysis of fluid motion , 2005, J. Vis..

[18]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[19]  Shuichi Nishio,et al.  Exploring the Natural Reaction of Young and Aged Person with Telenoid in a Real World , 2011, J. Adv. Comput. Intell. Intell. Informatics.