Blinking light patterns as artificial subtle expressions in human-robot speech interaction

Users' impressions of blinking light expressions used as artificial subtle expressions have been investigated. In a preliminary experiment, thirteen blinking patterns were used for investigating participants' impressions of their agreeableness. The highest and lowest valued blinking patterns were identified and used for a speech interaction experiment. In this experiment, 52 participants tried to reserve hotel rooms with a spoken dialogue system coupled with an interface robot using a blinking light expression. A sine wave, a random wave, a rectangular wave, and a no-blinking condition were used as artificial subtle expressions to express a robot's internal state of “processing” or “recognizing”. The results of a questionnaire showed the conditions did not significantly differ in terms of agreeableness, but the sine wave and the rectangular wave were evaluated as “more useful” than the no-blinking condition. Results of factor analyses suggested that the rectangular wave provides a comfortable impression of the dialogue.

[1]  Seiji Yamada,et al.  How appearance of robotic agents affects how people interpret the agents' attitudes , 2007, ACE '07.

[2]  Seiji Yamada,et al.  Smoothing human-robot speech interactions by using a blinking-light as subtle expression , 2008, ICMI '08.

[3]  Philip R. Cohen,et al.  Intentions in Communication , 1991, CL.

[4]  Michael Kipp,et al.  IGaze: Studying Reactive Gaze Behavior in Semi-immersive Human-Avatar Interactions , 2008, IVA.

[5]  Philip R. Cohen,et al.  Intentions in Communication , 1992, Language.

[6]  Seiji Yamada,et al.  Smoothing human-robot speech interaction with blinking-light expressions , 2008, RO-MAN 2008 - The 17th IEEE International Symposium on Robot and Human Interactive Communication.

[7]  Nigel Ward,et al.  On the Expressive Competencies Needed for Responsive Systems , 2003 .

[8]  Seiji Yamada,et al.  Artificial subtle expressions: intuitive notification methodology of artifacts , 2010, CHI.

[9]  Seiji Yamada,et al.  Proposing Artificial Subtle Expressions as an Intuitive Notification Methodology for Artificial Agents' Internal States , 2010 .

[10]  Rosalind W. Picard,et al.  Subtle Expressivity in a Robotic Computer , 2003 .

[11]  Aladdin Ayesh,et al.  Extracting subtle facial expression for emotional analysis , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[12]  船越 孝太郎,et al.  対話の低速化とArtificial Subtle Expressionによる発話衝突の抑制 , 2009 .

[13]  Seiji Yamada,et al.  Reducing Speech Collisions by Using an Artificial Subtle Expression in a Decelerated Spoken Dialogue , 2010 .

[14]  A. Kendon.  Do Gestures Communicate? A Review , 1994 .

[15]  Chun Chen,et al.  Subtle Facial Expression Modeling with Vector Field Decomposition , 2006, 2006 International Conference on Image Processing.

[16]  Takayuki Kanda,et al.  Humanlike conversation with gestures and verbal cues based on a three-layer attention-drawing model , 2006, Connect. Sci..

[17]  Takanori Komatsu,et al.  Artificial Subtle Expressions: Proposing intuitive notification methodology of agents' internal states , 2010 .

[18]  Seiji Yamada,et al.  Non-humanlike Spoken Dialogue: A Design Perspective , 2010, SIGDIAL Conference.

[19]  Christoph Bartneck,et al.  Subtle emotional expressions of synthetic characters , 2005, Int. J. Hum. Comput. Stud..

[20]  Yasuhiko Kitamura,et al.  Influence of social relationships on multiagent persuasion , 2008, AAMAS.

[21]  Takayuki Kanda,et al.  Footing in human-robot conversations: How robots might shape participant roles using gaze cues , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).