Anthropomorphising driver-truck interaction: a study on the current state of research and the introduction of two innovative concepts

The general role of personal assistants in form of anthropomorphised conversational, virtual or robotic agents in cars is subject to research since a few years and the first results indicate numerous positive effects of these anthropomorphised interfaces. However, no comprehensive review of the conducted studies has been comprised yet. Furthermore, existing studies on the effect of anthropomorphism mainly focus on passenger cars. This article provides a comprehensive review and summary of the conducted studies and investigates the applicability to commercial transportation, in particular to anthropomorphised interaction between truck driver and truck. In the first part of the article, a literature review describes the details, aspects and various forms of anthropomorphism as well as its observed positives effects. The review focusses on studies referring to anthropomorphism in passenger cars, complemented by relevant research results from non-automotive disciplines. The second part of this article aims to derive innovative and applicable concepts for the anthropomorphised driver-truck interfaces using the Design-Thinking approach: building on a comprehensive literature review to identify user needs and problems, an interdisciplinary expert workshop developed the two first anthropomorphised driver-truck interaction concepts. The paper finishes with carving out the differences between anthropomorphised car-driver and truck-driver interaction. The next step of research will then be the implementation of the developed interaction concepts in a first prototype followed by the respective user evaluation.

[1]  Nils Klowait,et al.  The quest for appropriate models of human-likeness: anthropomorphism in media equation research , 2017, AI & SOCIETY.

[2]  H. Kozima,et al.  A Robot that Learns to Communicate with Human Caregivers , 2001 .

[3]  F. D. Waal,et al.  The Age of Empathy: Nature's Lessons for a Kinder Society , 2009 .

[4]  Patrick Lin,et al.  Robot Ethics 2.0: From Autonomous Cars to Artificial Intelligence , 2017 .

[5]  Michio Okada,et al.  NAMIDA: Multiparty Conversation Based Driving Agents in Futuristic Vehicle , 2015, HCI.

[6]  Sang Ryong Kim,et al.  Are physically embodied social agents better than disembodied social agents?: The effects of physical embodiment, tactile interaction, and people's loneliness in human-robot interaction , 2006, Int. J. Hum. Comput. Stud..

[7]  C. Nass,et al.  How “Real” Are Computer Personalities? , 1996 .

[8]  N. Epley,et al.  The mind in the machine: Anthropomorphism increases trust in an autonomous vehicle , 2014 .

[9]  David Premack,et al.  Origins of human social competence. , 1995 .

[10]  Abigail Sellen,et al.  "Like Having a Really Bad PA": The Gulf between User Expectation and Experience of Conversational Agents , 2016, CHI.

[11]  Jana Fank,et al.  Factors for User Acceptance of Cooperative Assistance Systems: A Two-Step Study Assessing Cooperative Driving , 2017 .

[12]  Peter McGoldrick,et al.  On‐screen characters: their design and influence on consumer trust , 2006 .

[13]  Hermann Winner,et al.  Towards cooperative guidance and control of highly automated vehicles: H-Mode and Conduct-by-Wire , 2014, Ergonomics.

[14]  Michael G. Luchs.  A Brief Introduction to Design Thinking , 2015 .

[15]  Eudisley Gomes dos Anjos,et al.  Trends in the Use of Design Thinking for Embedded Systems , 2015, 2015 15th International Conference on Computational Science and Its Applications.

[16]  Clifford Nass,et al.  The media equation - how people treat computers, television, and new media like real people and places , 1996 .

[17]  Richard Pak,et al.  Decision support aids with anthropomorphic characteristics influence trust and performance in younger and older adults , 2012, Ergonomics.

[18]  Raja Parasuraman,et al.  The World is not Enough: Trust in Cognitive Agents , 2012 .

[19]  Iain R. Murray,et al.  Toward the simulation of emotion in synthetic speech: a review of the literature on human vocal emotion. , 1993, The Journal of the Acoustical Society of America.

[20]  L. R. Goldberg.  The structure of phenotypic personality traits. , 1993, The American psychologist.

[21]  Mica R. Endsley,et al.  The Out-of-the-Loop Performance Problem and Level of Control in Automation , 1995, Hum. Factors.

[22]  Markus Lienkamp,et al.  "I'm Your Personal Co-Driver - How Can I Assist You?" Assessing the Potential of Personal Assistants for Truck Drivers , 2019, IHSI.

[23]  Stefan Bauer,et al.  Acting together by mutual control: Evaluation of a multimodal interaction concept for cooperative driving , 2014, 2014 International Conference on Collaboration Technologies and Systems (CTS).

[24]  Wolfgang Minker,et al.  Human After All: Effects of Mere Presence and Social Interaction of a Humanoid Robot as a Co-Driver in Automated Driving , 2016, AutomotiveUI.

[25]  Ben J. A. Kröse,et al.  The Influence of Social Presence on Acceptance of an Assistive Social Robot and Screen Agent by Elderly Users , 2009 .

[26]  Björn W. Schuller,et al.  Emotion on the Road - Necessity, Acceptance, and Feasibility of Affective Computing in the Car , 2010, Adv. Hum. Comput. Interact..

[27]  Brian Scassellati,et al.  Theory of Mind for a Humanoid Robot , 2002, Auton. Robots.

[28]  Wendy Ju,et al.  Eliciting Conversation in Robot Vehicle Interactions , 2016, AAAI Spring Symposia.

[29]  Paul Ekman,et al.  A Methodological Discussion of Nonverbal Behavior , 1957 .

[30]  K. Darling.  'Who's Johnny?' Anthropomorphic Framing in Human-Robot Interaction, Integration, and Policy , 2015 .

[31]  J. Cacioppo,et al.  On seeing human: a three-factor theory of anthropomorphism. , 2007, Psychological review.

[32]  Wenhuan Wang,et al.  Smartphones as Social Actors? Social dispositional factors in assessing anthropomorphism , 2017, Comput. Hum. Behav..

[33]  Gregory M. P. O'Hare,et al.  Where Robots and Virtual Agents Meet , 2009, Int. J. Soc. Robotics.

[34]  Mike Dacey,et al.  Anthropomorphism as Cognitive Bias , 2017, Philosophy of Science.

[35]  Ben Shneiderman,et al.  Design Principles for Tools to Support Creative Thinking , 2005 .

[36]  Illah R. Nourbakhsh,et al.  A survey of socially interactive robots , 2003, Robotics Auton. Syst..

[37]  Kerstin Dautenhahn,et al.  I Could Be You: the Phenomenological Dimension of Social Understanding , 1997, Cybern. Syst..

[38]  Kenton Williams,et al.  Affective Robot Influence on Driver Adherence to Safety, Cognitive Load Reduction and Sociability , 2014, AutomotiveUI.

[39]  Murray Smith.  Engaging Characters: Fiction, Emotion, and the Cinema , 1995 .

[40]  L. R. Goldberg,et al.  Category breadth and hierarchical structure in personality: studies of asymmetries in judgments of trait implications. , 1986, Journal of personality and social psychology.

[41]  Hans Joas,et al.  Mind, Self, and Society: The Definitive Edition , 2015 .

[42]  Alan J. Dix,et al.  Are You Ready for a Drive?: User Perspectives on Autonomous Vehicles , 2017, CHI Extended Abstracts.

[43]  Jaap Ham,et al.  Combining Robotic Persuasive Strategies: The Persuasive Power of a Storytelling Robot that Uses Gazing and Gestures , 2015, Int. J. Soc. Robotics.

[44]  Steve Benford,et al.  User embodiment in collaborative virtual environments , 1995, CHI '95.

[45]  Brian R. Duffy,et al.  Anthropomorphism and the social robot , 2003, Robotics Auton. Syst..

[46]  Daniel R.A. Schallmo,et al.  Design Thinking erfolgreich anwenden , 2017 .

[47]  Hansjörg Hofmann,et al.  Evaluation of speech-based HMI concepts for information exchange tasks: A driving simulator study , 2015, Comput. Speech Lang..

[48]  Clifford Nass,et al.  Computers are social actors , 1994, CHI '94.

[49]  Jaap Ham,et al.  A Persuasive Robot to Stimulate Energy Conservation: The Influence of Positive and Negative Social Feedback and Task Similarity on Energy-Consumption Behavior , 2013, International Journal of Social Robotics.

[50]  Clifford Nass,et al.  Driver safety and information from afar: An experimental driving simulator study of wireless vs. in-car information services , 2008, Int. J. Hum. Comput. Stud..

[51]  Jacob O. Wobbrock,et al.  Put your best face forward: anthropomorphic agents, e-commerce consumers, and the law , 2000, AGENTS '00.

[52]  C. Nass,et al.  Does computer-synthesized speech manifest personality? Experimental tests of recognition, similarity-attraction, and consistency-attraction. , 2001, Journal of experimental psychology. Applied.

[53]  Alexandra Neukum,et al.  Increasing anthropomorphism and trust in automated driving functions by adding speech output , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[54]  John F. Bradley,et al.  Maintaining the Identify of Dynamically Embodied Agents , 2017 .

[55]  Akikazu Takeuchi,et al.  Communicative facial displays as a new conversational modality , 1993, INTERCHI.

[56]  D. W. Fiske.  Consistency of the factorial structures of personality ratings from different sour sources. , 1949, Journal of abnormal psychology.

[57]  Justine Cassell,et al.  Embodied conversational interface agents , 2000, CACM.

[58]  Andreas Butz,et al.  Supporting Trust in Autonomous Driving , 2017 .

[59]  Karin Slegers,et al.  Anthropomorphism as a Strategy to Engage End-Users in Health Data Ideation , 2016, NordiCHI.

[60]  Lee Sproull,et al.  My partner is a real dog: cooperation with social agents , 1996, CSCW '96.

[61]  D. Keltner,et al.  How Emotions Work: The Social Functions of Emotional Expression in Negotiations , 2000 .

[62]  Jaap Ham,et al.  What Makes Social Feedback from a Robot Work? Disentangling the Effect of Speech, Physical Appearance and Evaluation , 2010, PERSUASIVE.

[63]  T. Grodal.  Moving Pictures: A New Theory of Film Genres, Feelings, and Cognition , 1997 .

[64]  Brian Scassellati,et al.  Speech and Gaze Conflicts in Collaborative Human-Robot Interactions , 2014, CogSci.

[65]  P. Ekman,et al.  DIFFERENCES Universals and Cultural Differences in the Judgments of Facial Expressions of Emotion , 2004 .

[66]  Satoshi Okamoto,et al.  Anthropomorphic AI Agent Mediated Multimodal Interactions in Vehicles , 2017, AutomotiveUI.

[67]  Johannes Kraus,et al.  Elaborating Feedback Strategies for Maintaining Automation in Highly Automated Driving , 2016, AutomotiveUI.

[68]  Cynthia Breazeal,et al.  Designing sociable robots , 2002 .

[69]  P. Aggarwal,et al.  Is That Car Smiling at Me? Schema Congruity as a Basis for Evaluating Anthropomorphized Products , 2007 .

[70]  Stephen M. Casner,et al.  The challenges of partially automated driving , 2016, Commun. ACM.

[71]  C. Nass,et al.  Does computer-synthesized speech manifest personality? Experimental tests of recognition, similarity-attraction, and consistency-attraction. , 2001 .

[72]  Ing-Marie Jonsson,et al.  Driving with a Speech Interaction System: Effect of Personality on Performance and Attitude of Driver , 2014, HCI.

[73]  Dong-Soo Kwon,et al.  Affective interaction with a companion robot in an interactive driving assistant system , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[74]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[75]  Giuseppe Lugano,et al.  Virtual assistants and self-driving cars , 2017, 2017 15th International Conference on ITS Telecommunications (ITST).

[76]  Cynthia Breazeal,et al.  Towards leveraging the driver's mobile device for an intelligent, sociable in-car robotic assistant , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[77]  Cynthia Breazeal,et al.  Reducing Driver Task Load and Promoting Sociability through an Affective Intelligent Driving Agent (AIDA) , 2013, INTERACT.

[78]  Cynthia Breazeal,et al.  Empathic concern and the effect of stories in human-robot interaction , 2015, 2015 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[79]  K. Kotrschal,et al.  The mind behind anthropomorphic thinking: attribution of mental states to other species , 2015, Animal Behaviour.

[80]  Markus Lienkamp,et al.  Conceptual design and evaluation of a human machine interface for highly automated truck driving , 2018, 2018 IEEE Intelligent Vehicles Symposium (IV).

[81]  B. J. Fogg,et al.  Persuasive technology: using computers to change what we think and do , 2002, UBIQ.

[82]  O. John.  The "Big Five" factor taxonomy: Dimensions of personality in the natural language and in questionnaires. , 1990 .

[83]  Cynthia Breazeal,et al.  Affective Personalization of a Social Robot Tutor for Children's Second Language Skills , 2016, AAAI.

[84]  Natalie Tara Richardson,et al.  Assessing Truck Drivers’ and Fleet Managers’ Opinions Towards Highly Automated Driving , 2017 .

[85]  M. Grunwald.  Disney Animation The Illusion Of Life , 2016 .

[86]  Clifford Nass,et al.  Improving automotive safety by pairing driver emotion and car voice emotion , 2005, CHI Extended Abstracts.

[87]  Shanna R. Daly,et al.  Boosting Creativity in Idea Generation Using Design Heuristics , 2015 .

[88]  Klaus Lang,et al.  Design Thinking erfolgreich anwenden: So entwickeln Sie in 7 Phasen kundenorientierte Produkte und Dienstleistungen , 2020 .

[89]  Jan R. Landwehr,et al.  It's Got the Look: The Effect of Friendly and Aggressive “Facial” Expressions on Product Liking and Sales , 2011 .

[90]  Jane McGonigal,et al.  Keynote: Jane McGonigal , 2012, ACM Transactions on Graphics.

[91]  Claus-Christian Carbon,et al.  Laying eyes on headlights: eye movements suggest facial features in cars. , 2010, Collegium antropologicum.

[92]  C. Nass,et al.  Emotion in human-computer interaction , 2002 .

[93]  Rafael E. Banchs,et al.  Designing IDA - An Intelligent Driver Assistant for Smart City Parking in Singapore , 2015, INTERACT.

[94]  E. Delgado-Ballester,et al.  This anthropomorphised brand is so loveable: The role of self-brand integration , 2017 .

[95]  Susan R. Fussell,et al.  Anthropomorphic Interactions with a Robot and Robot–like Agent , 2008 .

[96]  Martin Baumann,et al.  Anthropomorphic agents, transparent automation and driver personality: towards an integrative multi-level model of determinants for effective driver-vehicle cooperation in highly automated vehicles , 2015, AutomotiveUI.

[97]  D. Ellinghaus,et al.  Lkw im Strassenverkehr - Eine Untersuchung ueber die Beziehungen zwischen Lkw- und Pkw-Fahrern - , 2002 .

[98]  C Evers.  Auswirkungen von Belastungen und Stress auf das Verkehrsverhalten von Lkw-Fahrern / The effects of strain and stress on the traffic behaviour of heavy goods vehicle drivers , 2009 .

[99]  G. Fricchione.  Descartes’ Error: Emotion, Reason and the Human Brain , 1995 .

[100]  B. J. Fogg,et al.  Can computer personalities be human personalities? , 1995, Int. J. Hum. Comput. Stud..

[101]  B. J. Fogg,et al.  Computers as persuasive social actors , 2003 .

[102]  M. Terwogt,et al.  Colors and emotions: preferences and combinations. , 1995, The Journal of general psychology.

[103]  Clifford Nass,et al.  Computers are social actors , 1994, CHI '94.

[104]  D. Tucker,et al.  Neural mechanisms of emotion. , 1992, Journal of consulting and clinical psychology.

[105]  M. Ryan Calo,et al.  Robots and Privacy , 2010 .

[106]  Christoph Bartneck,et al.  Anthropomorphism: Opportunities and Challenges in Human–Robot Interaction , 2014, International Journal of Social Robotics.

[107]  Abbie Griffin,et al.  Design Thinking: New Product Development Essentials from the PDMA , 2015 .

[108]  Monica N. Nicolescu,et al.  Learning and interacting in human-robot domains , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[109]  Clifford Nass,et al.  Thank you, I did not see that: in-car speech based information systems for older adults , 2005, CHI Extended Abstracts.

[110]  Aaron Powers,et al.  Matching robot appearance and behavior to tasks to improve human-robot cooperation , 2003, The 12th IEEE International Workshop on Robot and Human Interactive Communication, 2003. Proceedings. ROMAN 2003..

[111]  S. Guthrie,et al.  Faces in the Clouds: A New Theory of Religion , 1994 .

[112]  Heinrich H. Bülthoff,et al.  Render me real? , 2012, ACM Trans. Graph..

[113]  Alexandra Neukum,et al.  Speech improves human-automation cooperation in automated driving , 2016, MuC.

[114]  B. J. Fogg,et al.  How users reciprocate to computers: an experiment that demonstrates behavior change , 1997, CHI Extended Abstracts.

[115]  C. Creider.  Hand and Mind: What Gestures Reveal about Thought , 1994 .