Predicting and Regulating Participation Equality in Human-Robot Conversations: Effects of Age and Gender

In this paper, we investigate participation equality, in terms of speaking time, between users in multi-party human-robot conversations. We analyse a dataset where pairs of users (540 in total) interact with a conversational robot exhibited at a technical museum. The data encompass a wide range of different users in terms of age (adults/children) and gender (male/female), in different combinations. Overall, the analysis indicates that demographically heterogeneous pairs are more imbalanced, especially pairs of adults and children, where children are less prone to self-select in the turn-taking. The analysis also indicates that it is possible for the robot to reduce the imbalance by addressing the least dominant user and asking directed questions. However, for children to respond, it is important to seek mutual gaze and switch addressee often. Finally, we show that it is possible to predict the imbalance at an early stage in the interaction - in order to increase the participation equality as early as possible - and that knowledge about the users' age and gender helps in this prediction.

[1]  C. Leaper,et al.  Meta-Analyses of Gender Effects on Conversational Interruption: Who, What, When, Where, and How , 1998 .

[2]  Marco Antonio Martinez.  Dialogues among Children and between Children and Their Mothers. , 1987 .

[3]  A. Kendon.  Some functions of gaze-direction in social interaction. , 1967, Acta psychologica.

[4]  Julia Hirschberg,et al.  Turn-taking cues in task-oriented dialogue , 2011, Comput. Speech Lang..

[5]  Gabriel Skantze,et al.  Opportunities and Obligations to Take Turns in Collaborative Multi-Party Human-Robot Interaction , 2015, SIGDIAL Conference.

[6]  Samer Al Moubayed,et al.  Regulating Turn-Taking in Multi-child Spoken Interaction , 2015, IVA.

[7]  References , 1971 .

[8]  Jean-Marc Odobez,et al.  Recognizing Visual Focus of Attention From Head Pose in Natural Meetings , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[9]  E. Schegloff,et al.  A simplest systematics for the organization of turn-taking for conversation , 2015 .

[10]  S. Duncan,et al.  Some Signals and Rules for Taking Speaking Turns in Conversations , 1972 .

[11]  V. Yngve.  On getting a word in edgewise , 1970 .

[12]  Gabriel Skantze,et al.  Exploring Turn-taking Cues in Multi-party Human-robot Discussions about Objects , 2015, ICMI.

[13]  Gabriel Skantze,et al.  Data-driven models for timing feedback responses in a Map Task dialogue system , 2014, Comput. Speech Lang..

[14]  Tony McEnery,et al.  A Corpus-Based Study , 2001 .

[15]  Zdenek Salzmann.  Women, men and language: A sociolinguistic account of gender differences in language By Jennifer Coates (review) , 1994 .

[16]  Brian Scassellati,et al.  Classification of Children's Social Dominance in Group Interactions with Robots , 2015, ICMI.

[17]  Jessika Weiss.  Women Men And Language A Sociolinguistic Account Of Gender Differences In Language , 2016 .

[18]  Michael Argyle,et al.  The central Europe experiment: Looking at persons and looking at objects , 1976 .

[19]  Takayuki Kanda,et al.  Conversational gaze mechanisms for humanlike robots , 2012, TIIS.

[20]  Gabriel Skantze,et al.  Turn-taking control using gaze in multiparty human-computer dialogue: effects of 2d and 3d displays , 2011, AVSP.

[21]  Eric Horvitz,et al.  Facilitating multiparty dialog with gaze, gesture, and speech , 2010, ICMI-MLMI '10.

[22]  Julia Hirschberg,et al.  A Corpus-Based Study of Interruptions in Spoken Dialogue , 2012, INTERSPEECH.

[23]  J. Coates.  Women, Men, and Language: A Sociolinguistic Account of Sex Differences in Language , 1986 .

[24]  Sean Andrist,et al.  Fun and fair: influencing turn-taking in a multi-party game with a virtual agent , 2013, IDC.

[25]  A. Ichikawa,et al.  An Analysis of Turn-Taking and Backchannels Based on Prosodic and Syntactic Features in Japanese Map Task Dialogs , 1998, Language and speech.

[26]  Gabriel Skantze,et al.  Turn-taking, feedback and joint attention in situated human-robot interaction , 2014, Speech Commun..

[27]  Yukiko I. Nakano,et al.  Generating Robot Gaze on the Basis of Participation Roles and Dominance Estimation in Multiparty Interaction , 2015, TIIS.

[28]  Tatsuya Kawahara,et al.  Prediction of Turn-Taking by Combining Prosodic and Eye-Gaze Information in Poster Conversations , 2012, INTERSPEECH.

[29]  Susan Ervin-Tripp,et al.  Children's verbal turn-taking , 1979 .

[30]  Gabriel Skantze,et al.  The furhat Back-Projected humanoid Head-Lip Reading, gaze and Multi-Party Interaction , 2013, Int. J. Humanoid Robotics.

[31]  Gabriel Skantze,et al.  Furhat at Robotville : A Robot Head Harvesting the Thoughts of the Public through Multi-party Dialogue , 2012, IVA 2012.

[32]  D. O’connell,et al.  Turn-taking: A critical analysis of the research tradition , 1990 .

[33]  J. Maybin,et al.  Researching language and literacy in social context : a reader , 1994 .