Prosodic alignment in human–computer interaction

Androids that replicate humans in form also need to replicate them in behaviour to achieve a high level of believability or lifelikeness. We explore the minimal social cues that can induce in people the human tendency for social acceptance, or ethopoeia, toward artifacts, including androids. It has been observed that people exhibit a strong tendency to adjust to each other, through a number of speech and language features in human–human conversational interactions, to obtain communication efficiency and emotional engagement. We investigate in this paper the phenomena related to prosodic alignment in human–computer interactions, with particular focus on human–computer alignment of speech characteristics. We found that people exhibit unidirectional and spontaneous short-term alignment of loudness and response latency in their speech in response to computer-generated speech. We believe this phenomenon of prosodic alignment provides one of the key components for building social acceptance of androids.

[1]  C. Rogers.  Becoming a person , 1956 .

[2]  J. Matarazzo,et al.  Interviewer influence on durations of interviewee speech , 1963 .

[3]  J. Matarazzo,et al.  Speech Durations of Astronaut and Ground Communicator , 1964, Science.

[4]  S. Feldstein,et al.  Rhythms of dialogue , 1970 .

[5]  D. P. Hayes,et al.  Interruption Outcomes and Vocal Amplitude: Explorations in Social Psychophysics. , 1971 .

[6]  James T. Webb.  Chapter 6 – Interview Synchrony: An Investigation of Two Speech Rate Measures in an Automated Standardized Interview , 1972 .

[7]  J. Welkowitz,et al.  Interrelationships among warmth, genuineness, empathy, and temporal speech patterns in interpersonal interaction , 1973 .

[8]  D. Morris.  Manwatching : a field guide to human behaviour , 1977 .

[9]  Joseph Weizenbaum,et al.  and Machine , 1977 .

[10]  H. Giles,et al.  Speech Accommodation Theory: The First Decade and Beyond , 1987 .

[11]  Clifford Nass,et al.  Computers are social actors , 1994, CHI '94.

[12]  E. Couper-Kuhlen.  Prosody in conversation: The prosody of repetition: on quoting and mimicry , 1996 .

[13]  Clifford Nass,et al.  The media equation - how people treat computers, television, and new media like real people and places , 1996 .

[14]  Hideki Kawahara,et al.  Restructuring speech representations using a pitch-adaptive time-frequency smoothing and an instantaneous-frequency-based F0 extraction: Possible role of a repetitive structure in sounds , 1999, Speech Commun..

[15]  Clifford Nass,et al.  Does computer-generated speech manifest personality? an experimental test of similarity-attraction , 2000, CHI.

[16]  Jonas Beskow,et al.  Wavesurfer - an open source speech tool , 2000, INTERSPEECH.

[17]  J. Mann,et al.  The bottlenose dolphin: social relationships in a fission-fusion society , 2000 .

[18]  H. Ishiguro,et al.  A Model of Embodied Communications with Gestures between Human and Robots , 2001 .

[19]  Sharon L. Oviatt,et al.  Amplitude convergence in children²s conversational speech with animated personas , 2002, INTERSPEECH.

[20]  Sharon L. Oviatt,et al.  Adaptation of users² spoken dialogue patterns in a conversational interface , 2002, INTERSPEECH.

[21]  Illah R. Nourbakhsh,et al.  A survey of socially interactive robots , 2003, Robotics Auton. Syst..

[22]  Yasuhiro Katagiri,et al.  Prosodic Synchrony for Error Management in Human Computer Interaction , 2003 .

[23]  Yugo Takeuchi,et al.  Effects of echoic mimicry using hummed sounds on human-computer interaction , 2003, Speech Commun..

[24]  Mattias Heldner,et al.  Prosodic adaptation in human-computer interaction , 2003 .

[25]  Brian R. Duffy,et al.  Anthropomorphism and the social robot , 2003, Robotics Auton. Syst..

[26]  M. Pickering,et al.  Toward a mechanistic psychology of dialogue , 2004, Behavioral and Brain Sciences.

[27]  M. Natale.  CONVERGENCE OF MEAN VOCAL INTENSITY IN DYADIC COMMUNICATION AS A FUNCTION OF SOCIAL DESIRABILITY , 1975 .

[28]  Hiroshi Ishiguro,et al.  Android science: Toward a new cross-interdisciplinary framework , 2005 .

[29]  Cynthia Breazeal,et al.  Early Experiments using Motivations to Regulate Human-Robot Interaction , 2007 .