Stereotypes or golden rules? Exploring likable voice traits of social robots as active aging companions for tech-savvy baby boomers in Taiwan

Abstract Social robots are foreseen to be a growing category of assistive devices for baby boomers in helping them live independently at home and in good health for longer. Artificial intelligence and speech recognition are making natural language user interfaces possible. Yet voices of social robots could influence users' preferences and perceptions in ways that have not been widely explored yet, let alone in Chinese-speaking context. A quantitative study was conducted to probe what voice characteristics of social robots baby boomers may prefer and what personality traits they would associate with various pitch, speech rate, and intonation in Mandarin. While the findings coincide with previous research in that female, extroverted voices were preferred by most participants, many individual differences remain, which could be attributed to differences in demographics, lifestyles, and personality traits. This study contributes to design decisions that would take individual differences into consideration. Social robots that could learn and adapt to people's preferences, perceptions, as well as the tasks at hand may fare better than a one-size-fits-all approach. We believe that voice user interfaces will play a key role in elderly people's initial acceptance and continuing engagement of social robots.

[1]  Tainyi (Ted) Luor,et al.  Exploring the critical quality attributes and models of smart homes. , 2015, Maturitas.

[2]  A. Todorov,et al.  How Do You Say ‘Hello’? Personality Impressions from Brief Novel Voices , 2014, PloS one.

[3]  E. Kramer ELIMINATION OF VERBAL CUES IN JUDGMENTS OF EMOTION FROM VOICE. , 1964, Journal of abnormal psychology.

[4]  James C. Lester,et al.  The Case for Social Agency in Computer-Based Teaching: Do Students Learn More Deeply When They Interact With Animated Pedagogical Agents? , 2001 .

[5]  Imran Ali,et al.  Personality traits, individual innovativeness and satisfaction with life , 2018, Journal of Innovation & Knowledge.

[6]  Alessandro Vinciarelli,et al.  The voice of personality: mapping nonverbal vocal behavior into trait attributions , 2010, SSPW '10.

[7]  Yeh-Liang Hsu,et al.  The use of psychophysiological methods in the evaluation of mental commitment robots for elderly care , 2015 .

[8]  Christoph Bartneck,et al.  Meta analysis of the usage of the Godspeed Questionnaire Series , 2015, 2015 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[9]  Deryle W. Lonsdale,et al.  The Effects of Average Fundamental Frequency and Variance of Fundamental Frequency on Male Vocal Attractiveness to Women , 2006 .

[10]  Karl F. MacDorman,et al.  Revisiting the uncanny valley theory: Developing and validating an alternative to the Godspeed indices , 2010, Comput. Hum. Behav..

[11]  Clifford Nass,et al.  Wired for Speech: How Voice Activates and Advances the Human-Computer Relationship , 2005 .

[12]  P. Costa,et al.  Four ways five factors are basic , 1992 .

[13]  Illah R. Nourbakhsh,et al.  A survey of socially interactive robots , 2003, Robotics Auton. Syst..

[14]  Deborah A. Prentice,et al.  What Women and Men Should Be, Shouldn't be, are Allowed to be, and don't Have to Be: The Contents of Prescriptive Gender Stereotypes , 2002 .

[15]  R. Mayer,et al.  Fostering social agency in multimedia learning: Examining the impact of an animated agent’s voice ☆ , 2005 .

[16]  Hsi-Peng Lu,et al.  Active Aging: A Systematic Literature Review of 2000-2014 SSCI Journal Articles , 2015 .

[17]  A. Little,et al.  Integrating cues of social interest and voice pitch in men's preferences for women's voices , 2008, Biology Letters.

[18]  Clifford Nass,et al.  Consistency of personality in interactive characters: verbal cues, non-verbal cues, and user characteristics , 2000, Int. J. Hum. Comput. Stud..

[19]  N. Anderson,et al.  Primacy effects in personality impression formation. , 1961, Journal of abnormal and social psychology.

[20]  William C. Mann,et al.  The Gator Tech Smart House: a programmable pervasive space , 2005, Computer.

[21]  Sarah N. Woods,et al.  Are robots like people?: Relationships between participant and robot personality traits in human–robot interaction studies , 2007 .

[22]  S. L. See,et al.  The influence of voice pitch on the evaluation of a social robot receptionist , 2011, 2011 International Conference on User Science and Engineering (i-USEr ).

[23]  T.B. Martin,et al.  Practical applications of voice input to machines , 1976, Proceedings of the IEEE.

[24]  R. W. Rogers,et al.  Sex role stereotypes: developmental aspects and early intervention. , 1976, Child development.

[25]  Casey A. Klofstad,et al.  Sounds like a winner: voice pitch influences perception of leadership capacity in both men and women , 2011, Proceedings of the Royal Society B: Biological Sciences.

[26]  Etienne Mullet,et al.  Perspective-taking judgments among young adults, middle-aged, and elderly people. , 2005, Journal of experimental psychology. Applied.

[27]  Andrew W. Perkins,et al.  Implicit Assimilation and Explicit Contrast: A Set/Reset Model of Response to Celebrity Voice-Overs , 2005 .

[28]  K. Dautenhahn Robots we like to live with?! - a developmental perspective on a personalized, life-long robot companion , 2004, RO-MAN 2004. 13th IEEE International Workshop on Robot and Human Interactive Communication (IEEE Catalog No.04TH8759).

[29]  Gerhard Sagerer,et al.  Understanding Social Robots , 2009, 2009 Second International Conferences on Advances in Computer-Human Interactions.

[30]  David W. Addington The relationship of selected vocal characteristics to personality perception , 1968 .

[31]  C. Nass,et al.  How “Real” Are Computer Personalities? , 1996 .

[32]  Hamid Aghajan,et al.  Smart home care network using sensor fusion and distributed vision-based reasoning , 2006, VSSN '06.

[33]  Patricia D. Mautone,et al.  Social cues in multimedia learning: Role of speaker's voice. , 2003 .

[34]  Ian R. Fasel,et al.  Auditory mood detection for social and educational robots , 2008, 2008 IEEE International Conference on Robotics and Automation.

[35]  Maartje M. A. de Graaf,et al.  Sharing a life with Harvey: Exploring the acceptance of and relationship-building with a social robot , 2015, Comput. Hum. Behav..

[36]  P. S. Fisher,et al.  Voice Controlled Smart House , 1993, IEEE 1993 International Conference on Consumer Electronics Digest of Technical Papers.

[37]  Clifford Nass,et al.  The media equation - how people treat computers, television, and new media like real people and places , 1996 .

[38]  Murdock,et al.  The serial position effect of free recall , 1962 .

[39]  A. Kalache,et al.  Active ageing: a policy framework. , 2003, Advances in gerontology = Uspekhi gerontologii.

[40]  A. Rodríguez Valiente,et al.  Extended high-frequency (9–20 kHz) audiometry reference thresholds in 645 healthy subjects , 2014, International journal of audiology.

[41]  Mounir Mokhtari,et al.  Networking and Communication in Smart Home for People with Disabilities , 2004, ICCHP.

[42]  Ya-Huei Wu,et al.  Designing robots for the elderly: appearance issue and beyond. , 2012, Archives of gerontology and geriatrics.

[43]  D. Perrett,et al.  The Role of Femininity and Averageness of Voice Pitch in Aesthetic Judgments of Women's Voices , 2008, Perception.

[44]  Klaus R. Scherer,et al.  Voice quality analysis of American and German speakers , 1974 .

[45]  Michael A. Goodrich,et al.  Human-Robot Interaction: A Survey , 2008, Found. Trends Hum. Comput. Interact..

[46]  R W Schafer Scientific bases of human-machine communication by voice. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[47]  S K Tuomi,et al.  Characteristics of simulated sexy voice. , 1979, Folia phoniatrica.

[48]  Bruce L. Smith,et al.  Effects of Speech Rate on Personality Perception , 1975, Language and speech.

[49]  A. Little,et al.  A domain-specific opposite-sex bias in human preferences for manipulated voice pitch , 2010, Animal Behaviour.

[50]  C Kamm,et al.  User Interfaces for voice applications , 1994 .

[51]  Sebastian Möller,et al.  Evaluating the speech output component of a smart-home system , 2006, Speech Commun..

[52]  Hadley Cantril,et al.  Judging Personality from Voice , 1934 .

[53]  Brandon E Gavett,et al.  The effects of age on the learning and forgetting of primacy, middle, and recency components of a multi-trial word list , 2017, Journal of clinical and experimental neuropsychology.

[54]  M. Matarić,et al.  Benchmarks for evaluating socially assistive robotics , 2007 .

[55]  Haizhou Li,et al.  Making Social Robots More Attractive: The Effects of Voice Pitch, Humor and Empathy , 2013, Int. J. Soc. Robotics.

[56]  K. M. Lee,et al.  Can robots manifest personality? : An empirical test of personality recognition, social responses, and social presence in human-robot interaction , 2006 .

[57]  Bruce A. MacDonald,et al.  Acceptance of Healthcare Robots for the Older Population: Review and Future Directions , 2009, Int. J. Soc. Robotics.

[58]  David Griol,et al.  The Conversational Interface: Talking to Smart Devices , 2016 .

[59]  J. Liénard,et al.  Women use voice parameters to assess men's characteristics , 2006, Proceedings of the Royal Society B: Biological Sciences.

[60]  Aaron Powers,et al.  Matching robot appearance and behavior to tasks to improve human-robot cooperation , 2003, The 12th IEEE International Workshop on Robot and Human Interactive Communication, 2003. Proceedings. ROMAN 2003..

[61]  C. Nass,et al.  Does computer-synthesized speech manifest personality? Experimental tests of recognition, similarity-attraction, and consistency-attraction. , 2001 .

[62]  R. Riggio,et al.  Impression formation: the role of expressive behavior. , 1986, Journal of personality and social psychology.

[63]  R. Lippa,et al.  The Relation of Gender, Personality, and Intelligence to Judges' Accuracy in Judging Strangers' Personality From Brief Video Segments , 2000 .

[64]  Pei-Luen Patrick Rau,et al.  Effects of communication style and culture on ability to accept recommendations from robots , 2009, Comput. Hum. Behav..

[65]  Leslie A. Zebrowitz,et al.  Culture, gender and health care stigma: Practitioners' response to facial masking experienced by people with Parkinson's disease. , 2011, Social Science & Medicine (1967).

[66]  Anders Eriksson,et al.  The frequency range of the voice fundamental in the speech of male and female adults , 1993 .

[67]  S. Collins,et al.  Vocal and visual attractiveness are related in women , 2003, Animal Behaviour.

[68]  D. W. Robinson,et al.  Age effect in hearing - a comparative analysis of published threshold data. , 1979, Audiology : official organ of the International Society of Audiology.

[69]  P R Cohen,et al.  The role of voice input for human-machine communication. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[70]  C. Nass,et al.  Machines and Mindlessness , 2000 .

[71]  C. Aronovitch The voice of personality: stereotyped judgments and their relation to voice quality and sex of speaker. , 1976, The Journal of social psychology.

[72]  Martha E. Pollack,et al.  Intelligent Technology for an Aging Population: The Use of AI to Assist Elders with Cognitive Impairment , 2005, AI Mag..

[73]  J. Forgas Mood and judgment: the affect infusion model (AIM). , 1995, Psychological bulletin.

[74]  L. Streeter,et al.  Effects of Pitch and Speech Rate on Personal Attributions , 1979 .

[75]  Lucie Richard,et al.  Inventory and analysis of definitions of social participation found in the aging literature: proposed taxonomy of social activities. , 2010, Social science & medicine.