Direct imitation of human facial expressions by a user-interface robot

Imitating the facial expressions of another person is a meaningful signal within interpersonal communication. Providing a robot with the capability of imitating the face of an interactant marks a first step towards implementing a communication model of mimicry. In this paper, we present a novel approach to facial expression imitation which does not require observed expressions to be assigned to a set of basic emotional expressions. Rather, arbitrary expressions are directly imitated exclusively based on camera images of the interactant's face. Consequently, the repertoire of displayable expressions is extended significantly and becomes more appropriate for interactions with humans.

[1]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[2]  Shuzhi Sam Ge,et al.  Facial expression imitation in human robot interaction , 2008, RO-MAN 2008 - The 17th IEEE International Symposium on Robot and Human Interactive Communication.

[3]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[4]  Fumio Hara,et al.  Realistic facial expressions by SMA driven face robot , 2001, Proceedings 10th IEEE International Workshop on Robot and Human Interactive Communication. ROMAN 2001 (Cat. No.01TH8591).

[5]  Xue Yan,et al.  iCat: an animated user-interface robot with personality , 2005, AAMAS '05.

[6]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[7]  Fernando De la Torre,et al.  Facial Expression Analysis , 2011, Visual Analysis of Humans.

[8]  Christian Lebiere,et al.  The Cascade-Correlation Learning Architecture , 1989, NIPS.

[9]  Stephan Trenn,et al.  Multilayer Perceptrons: Approximation Order and Necessary Number of Hidden Units , 2008, IEEE Transactions on Neural Networks.

[10]  J. Bavelas,et al.  "I show how you feel": Motor mimicry as a communicative act. , 1986 .

[11]  P. Watzlawick,et al.  Pragmatics of Human Communication: A Study of Interactional Patterns, Pathologies and Paradoxes , 1964 .

[12]  E. Oja,et al.  Independent Component Analysis , 2013 .

[13]  Bernhard Schölkopf,et al.  New Support Vector Algorithms , 2000, Neural Computation.

[14]  Myung Jin Chung,et al.  Development of a Facial Expression Imitation System , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Takeo Kanade,et al.  Recognizing Action Units for Facial Expression Analysis , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Anil K. Jain,et al.  Face Detection in Color Images , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[18]  Takeo Kanade,et al.  Facial Expression Analysis , 2011, AMFG.

[19]  P. Ekman,et al.  Emotion in the Human Face: Guidelines for Research and an Integration of Findings , 1972 .

[20]  B. V. K. Vijaya Kumar,et al.  Face authentication for multiple subjects using eigenflow , 2003, Pattern Recognit..

[21]  Takeo Kanade,et al.  Neural Network-Based Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Marc Hanheide,et al.  Automatic Initialization for Facial Analysis in Interactive Robotics , 2008, ICVS.

[23]  Nicole Chovil.  Social determinants of facial displays , 1991 .

[24]  C. Bartneck,et al.  In your face, robot! The influence of a character's embodiment on how users perceive its emotional expressions , 2004 .

[25]  Alex Black,et al.  Motor mimicry as primitive empathy. , 1987 .

[26]  R. Kraut,et al.  Social and emotional messages of smiling: An ethological approach. , 1979 .

[27]  Britta Wrede,et al.  Playing a different imitation game: Interaction with an Empathic Android Robot , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[28]  Laurene V. Fausett,et al.  Fundamentals Of Neural Networks , 1994 .

[29]  Lijun Yin,et al.  A study of non-frontal-view facial expressions recognition , 2008, 2008 19th International Conference on Pattern Recognition.

[30]  Ioannis Pitas,et al.  Facial Expression Recognition in Image Sequences Using Geometric Deformation Features and Support Vector Machines , 2007, IEEE Transactions on Image Processing.