Use of nonverbal speech cues in social interaction between human and robot: emotional and interactional markers

We focus on audio cues required for the interaction between a human and a robot. We argue that a multi-level use of different paralinguistic cues is needed to pilot the decisions of the robot. Our challenge is to know how to use them to pilot the human-robot interaction. We offer in this paper a protocol for a study on the way paralinguistic cues can impact the human-robot interaction, by interpreting the low-level cues computed from speech into an emotional and interactional profile of the user. This study will be carried out through a game between two children and a robot.

[1]  Hadley Cantril,et al.  The social psychology of everyday life. , 1934 .

[2]  P. Kuhl,et al.  Acoustic determinants of infant preference for motherese speech , 1987 .

[3]  N. Markel.  Speaking style as an expression of solidarity: Words per pause , 1990, Language in Society.

[4]  R. McCrae,et al.  An introduction to the five-factor model and its applications. , 1992, Journal of personality.

[5]  Cynthia Breazeal,et al.  Robot in Society: Friend or Appliance? , 1999 .

[6]  Atsuo Takanishi,et al.  A new mental model for humanoid robots for human friendly communication introduction of learning system, mood vector and second order equations of emotion , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[7]  Masahiro Fujita,et al.  Associated Emotion and Its Expression in an Entertainment Robot QRIO , 2004, ICEC.

[8]  Lori Lamel,et al.  Challenges in real-life emotion annotation and machine learning based detection , 2005, Neural Networks.

[9]  Roddy Cowie,et al.  Real life emotions in French and English TV video clips: an integrated annotation protocol combining continuous and discrete approaches , 2006, LREC.

[10]  Katherine Isbister.  Better Game Characters by Design - A Psychological Approach , 2006, The Morgan Kaufmann series in interactive 3D technology.

[11]  Linda B. Smith,et al.  The dynamic lift of developmental process. , 2007, Developmental science.

[12]  J. Lerner,et al.  Oxford Companion to the Affective Sciences , 2007 .

[13]  Magalie Ochs,et al.  Simulation of the Dynamics of Nonplayer Characters' Emotions and Social Relations in Games , 2009, IEEE Transactions on Computational Intelligence and AI in Games.

[14]  K. Scherer,et al.  Personality and emotion , 2009 .

[15]  Ana Paiva,et al.  Affect recognition for interactive companions: challenges and design in real world scenarios , 2009, Journal on Multimodal User Interfaces.

[16]  L. Devillers,et al.  A Wizard-of-Oz game for collecting emotional audio data in a children-robot interaction , 2009, AFFINE '09.