Person-Directed Pointing Gestures and Inter-Personal Relationship: Expression of Politeness to Friendliness by Android Robots

Pointing at a person is usually deemed to be impolite. However, several different forms of person-directed pointing gestures commonly appear in casual dialogue interactions. In this study, we first analyzed pointing gestures in human-human dialogue interactions and observed different trends in the use of gesture types, based on the inter-personal relationships between dialogue partners. Then we conducted multiple subjective experiments by systematically creating behaviors in an android robot to investigate the effects of different types of pointing gestures on the impressions of its behaviors. Several factors were included: pointing gesture motion types (hand shapes, such as an open palm or an extended index finger, hand orientation, and motion direction), language types (formal or colloquial), gesture speeds, and gesture hold duration. Our evaluation results indicated that impressions of polite or casual are affected by the analyzed factors, and a behavior's appropriateness depends on the inter-personal relationship with the dialogue partner.

[1]  E. Berscheid,et al.  The Relationship Closeness Inventory : Assessing the Closeness of Interpersonal Relationships , 2004 .

[2]  Takashi Minato,et al.  Motion Analysis in Vocalized Surprise Expressions and Motion Generation in Android Robots , 2017, IEEE Robotics and Automation Letters.

[3]  Stefan Kopp,et al.  Gesture and speech in interaction: An overview , 2014, Speech Commun..

[4]  Takashi Minato,et al.  Online processing for speech-driven gesture motion generation in android robots , 2019, 2019 IEEE-RAS 19th International Conference on Humanoid Robots (Humanoids).

[5]  Takashi Minato,et al.  Motion generation in android robots during laughing speech , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[6]  Bilge Mutlu,et al.  Modeling and Evaluating Narrative Gestures for Humanlike Robots , 2013, Robotics: Science and Systems.

[7]  Hélène Cochet,et al.  Pointing gesture in young children Hand preference and language development , 2012 .

[8]  Hiroshi Ishiguro,et al.  A Speech-Driven Hand Gesture Generation Method and Evaluation in Android Robots , 2018, IEEE Robotics and Automation Letters.

[9]  Joyce Yue Chai,et al.  Embodied Collaborative Referring Expression Generation in Situated Human-Robot Interaction , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[10]  Youngwoo Yoon,et al.  Robots Learn Social Skills: End-to-End Learning of Co-Speech Gesture Generation for Humanoid Robots , 2018, 2019 International Conference on Robotics and Automation (ICRA).

[11]  Stefan Kopp,et al.  Generation and Evaluation of Communicative Robot Gesture , 2012, Int. J. Soc. Robotics.

[12]  H. Ishiguro,et al.  Analysis of the factors involved in person-directed pointing gestures in dialogue speech , 2020, Speech Prosody 2020.

[13]  Michael Neff,et al.  Evaluating the Effect of Gesture and Language on Personality Perception in Conversational Agents , 2010, IVA.

[14]  Tatsuya Nomura,et al.  Effects of Polite Behaviors Expressed by Robots: A Psychological Experiment in Japan , 2010, Int. J. Synth. Emot..

[15]  Tatsuya Kawahara,et al.  ERICA: The ERATO Intelligent Conversational Android , 2016, 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[16]  Sotaro Kita,et al.  Cross-cultural variation of speech-accompanying gesture: A review , 2009, Speech Accompanying-Gesture.

[17]  Laura K. Guerrero,et al.  Nonverbal Communication in Close Relationships , 2005 .

[18]  Takayuki Kanda,et al.  It's not polite to point Generating socially-appropriate deictic behaviors towards people , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[19]  Nikolaos Mavridis,et al.  A review of verbal and non-verbal human-robot interactive communication , 2014, Robotics Auton. Syst..