Effects of voice-adaptation and social dialogue on perceptions of a robotic learning companion

With a growing number of applications involving social human-robot interactions, there is an increasingly important role for socially responsive speech interfaces that can effectively engage the user. For example, learning companions provide both task-related feedback and motivational support for students with the goal of improving learning. As a learning companion's ability to be socially responsive increases, so do learning outcomes. This paper presents a socially responsive speech interface for an embodied, robotic learning companion. We explore two methods of social responsiveness. The first method introduces social responses into the dialogue, while the second method augments these responses with voice-adaptation based on acoustic-prosodic entrainment. We evaluate the effect of a social, voice-adaptive robotic learning companion on social variables such as social presence and rapport, and we compare this to a companion with only social dialogue and one with neither social dialogue nor voice-adaptions. We contrast the effects against those of individual factors, such as gender. We find (1) that social presence is significantly higher with a social voice-adaptive speech interface than with purely social dialogue, and (2) that females feel significantly more rapport and are significantly more persistent in interactions with a robotic learning companion than males.

[1]  Susannah B. F. Paletz,et al.  Lexical entrainment and success in student engineering groups , 2012, 2012 IEEE Spoken Language Technology Workshop (SLT).

[2]  Rivka Levitan,et al.  Entrainment in Spoken Dialogue Systems: Adopting, Predicting and Influencing User Behavior , 2013, NAACL.

[3]  Brian Scassellati,et al.  Robots that express emotion elicit better human teaching , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[4]  J. Cassell,et al.  Social Dialongue with Embodied Conversational Agents , 2005 .

[5]  Taezoon Park,et al.  When Stereotypes Meet Robots: The Effect of Gender Stereotypes on People's Acceptance of a Security Robot , 2013, HCI.

[6]  Carolyn Penstein Rosé,et al.  Socially Capable Conversational Tutors Can Be Effective in Collaborative Learning Situations , 2010, Intelligent Tutoring Systems.

[7]  Christoph Bartneck,et al.  Expressive robots in education: varying the degree of social supportive behavior of a robotic tutor , 2010, CHI.

[8]  Cindy L. Bethel,et al.  Validation of vocal prosody modifications to communicate emotion in robot speech , 2015, 2015 International Conference on Collaboration Technologies and Systems (CTS).

[9]  R. Bales.  Interaction process analysis; a method for the study of small groups. , 2013 .

[10]  F. Tanaka,et al.  Children teach a care-receiving robot to promote their learning , 2012, J. Hum. Robot Interact..

[11]  T. Chartrand,et al.  The Chameleon Effect as Social Glue: Evidence for the Evolutionary Significance of Nonconscious Mimicry , 2003 .

[12]  Ning Wang,et al.  Creating Rapport with Virtual Agents , 2007, IVA.

[13]  R. Porzel.  How Entrainment Increases Dialogical Effectiveness , 2006 .

[14]  Stephanie A. Borrie,et al.  Disordered speech disrupts conversational entrainment: a study of acoustic-prosodic entrainment and communicative success in populations with communication challenges , 2015, Front. Psychol..

[15]  R. Hake.  Relationship of Individual Student Normalized Learning Gains in Mechanics with Gender , High-School Physics , and Pretest Scores on Mathematics and Spatial Visualization , 2002 .

[16]  Erin Walker,et al.  Naturalness and rapport in a pitch adaptive learning companion , 2015, 2015 IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU).

[17]  Khalil Sima'an,et al.  Wired for Speech: How Voice Activates and Advances the Human-Computer Relationship , 2006, Computational Linguistics.

[18]  Elizabeth Murphy,et al.  Teachers' Perspectives on Motivation in High-School Distance Education. , 2009 .

[19]  Jodi Forlizzi,et al.  Personalization in HRI: A longitudinal field experiment , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[20]  Gautam Biswas,et al.  LEARNING BY TEACHING: A NEW AGENT PARADIGM FOR EDUCATIONAL SOFTWARE , 2005, Appl. Artif. Intell..

[21]  Johanna D. Moore,et al.  Explorer A Computational Cognitive Model of Syntactic Priming , 2017 .

[22]  Paul Boersma,et al.  Praat: doing phonetics by computer , 2003 .

[23]  Stephanie A. Borrie,et al.  Rhythm as a coordinating device: entrainment with disordered speech. , 2014, Journal of speech, language, and hearing research : JSLHR.

[24]  Pierre Dillenbourg,et al.  When Children Teach a Robot to Write: An Autonomous Teachable Humanoid Which Uses Simulated Handwriting , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[25]  Paul Boersma,et al.  Praat, a system for doing phonetics by computer , 2002 .

[26]  Cynthia Breazeal,et al.  Emotion and sociable humanoid robots , 2003, Int. J. Hum. Comput. Stud..

[27]  Vanessa Evers,et al.  The influence of social presence on acceptance of a companion robot by older people , 2008 .

[28]  Simon Baron-Cohen,et al.  The relationship between SAM and ToMM: two hypotheses , 1996 .

[29]  Sharon L. Oviatt,et al.  Amplitude convergence in children²s conversational speech with animated personas , 2002, INTERSPEECH.

[30]  L. Tickle-Degnen,et al.  The Nature of Rapport and Its Nonverbal Correlates , 1990 .

[31]  Illah R. Nourbakhsh,et al.  A survey of socially interactive robots , 2003, Robotics Auton. Syst..

[32]  Julia Hirschberg,et al.  Entrainment and Turn-Taking in Human-Human Dialogue , 2015, AAAI Spring Symposia.

[33]  Takayuki Kanda,et al.  > Replace This Line with Your Paper Identification Number (double-click Here to Edit) < 2 , 2022 .

[34]  Heather Pon-Barry,et al.  Acoustic-Prosodic Entrainment and Rapport in Collaborative Learning Dialogues , 2014, MLA@ICMI.

[35]  Winslow Burleson,et al.  Gender-Specific Approaches to Developing Emotionally Intelligent Learning Companions , 2007, IEEE Intelligent Systems.

[36]  Charles R. Crowell,et al.  Robot social presence and gender: Do females view robots differently than males? , 2008, 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[37]  Rod D. Roscoe,et al.  Understanding Tutor Learning: Knowledge-Building and Knowledge-Telling in Peer Tutors’ Explanations and Questions , 2007 .

[38]  Adriana Tapus,et al.  Socially Assistive Robots: The Link between Personality, Empathy, Physiological Signals, and Task Performance , 2008, AAAI Spring Symposium: Emotion, Personality, and Social Behavior.

[39]  R. Ploetzner,et al.  Learning by explaining to oneself and to others. , 1999 .

[40]  Jacob Cohen,et al.  Statistical power analysis : a computer program , 1988 .

[41]  Amaury Daele,et al.  La socialisation des enseignants au sein des communautés virtuelles : contribution à une compréhension du rapport à la communauté , 2009 .