Taming the eHMI jungle: A classification taxonomy to guide, compare, and assess the design principles of automated vehicles' external human-machine interfaces

Abstract There is a growing body of research in the field of interaction between automated vehicles and other road users in their vicinity. To facilitate such interactions, researchers and designers have explored designs, and this line of work has yielded several concepts of external Human-Machine Interfaces (eHMI) for vehicles. Literature and media review reveals that the description of interfaces is often lacking in fidelity or details of their functionalities in specific situations, which makes it challenging to understand the originating concepts. There is also a lack of a universal understanding of the various dimensions of a communication interface, which has impeded a consistent and coherent addressal of the different aspects of the functionalities of such interface concepts. In this paper, we present a unified taxonomy that allows a systematic comparison of the eHMI across 18 dimensions, covering their physical characteristics and communication aspects from the perspective of human factors and human-machine interaction. We analyzed and coded 70 eHMI concepts according to this taxonomy to portray the state of the art and highlight the relative maturity of different contributions. The results point to a number of unexplored research areas that could inspire future work. Additionally, we believe that our proposed taxonomy can serve as a checklist for user interface designers and researchers when developing their interfaces.

[1]  Iyad Rahwan,et al.  The social dilemma of autonomous vehicles , 2015, Science.

[2]  Frank Flemisch,et al.  Automated Driving using Shared and Cooperative Guidance and Control: Revisiting past Research with a new Model , 2016 .

[3]  Melissa Cefkin,et al.  Evaluation of an Autonomous Vehicle External Communication System Concept: A Survey Study , 2017 .

[4]  Rikard Fredriksson,et al.  Communicating Intent of Automated Vehicles to Pedestrians , 2018, Front. Psychol..

[5]  Nobuyuki Uchida,et al.  Driver behavior in car-to-pedestrian incidents: An application of the Driving Reliability and Error Analysis Method (DREAM). , 2013, Accident; analysis and prevention.

[6]  Denis Lalanne,et al.  Pedestrians and Visual Signs of Intent , 2019, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[7]  Klaus Bengler,et al.  External HMIs and Their Effect on the Interaction Between Pedestrians and Automated Vehicles , 2018, IHSI.

[8]  Jan Nilsson,et al.  Command-Based Driving for Tactical Control of Highly Automated Vehicles , 2017 .

[9]  Annette Werner,et al.  New Colours for Autonomous Driving: An Evaluation of Chromaticities for the External Lighting Equipment of Autonomous Vehicles , 2018 .

[10]  Jonas Andersson,et al.  Let’s communicate: How to operate in harmony with automated vehicles , 2017 .

[11]  Patricia R. DeLucia,et al.  Effects of Size on Collision Perception and Implications for Perceptual Theory and Transportation Safety , 2013 .

[12]  Christian Berger,et al.  The Best Rated Human–Machine Interface Design for Autonomous Vehicles in the 2016 Grand Cooperative Driving Challenge , 2018, IEEE Transactions on Intelligent Transportation Systems.

[13]  Håkan Alm,et al.  External Human–Machine Interfaces for Autonomous Vehicle-to-Pedestrian Communication: A Review of Empirical Work , 2019, Front. Psychol..

[14]  David Sirkin,et al.  The Case for Implicit External Human-Machine Interfaces for Autonomous Vehicles , 2019, AutomotiveUI.

[15]  Mark Colley,et al.  Including people with impairments from the start: external communication of autonomous vehicles , 2019, AutomotiveUI.

[16]  Malte Risto,et al.  Human-Vehicle Interfaces: The Power of Vehicle Movement Gestures in Human Road User Coordination , 2017 .

[17]  P R DeLucia,et al.  Pictorial and motion-based information for depth perception. , 1991, Journal of experimental psychology. Human perception and performance.

[18]  Jonas Andersson,et al.  Hello Human, can you read my mind? , 2017, ERCIM News.

[19]  Klaus Bengler,et al.  From HMI to HMIs: Towards an HMI Framework for Automated Driving , 2020, Inf..

[20]  Sowmya Somanath,et al.  Communicating Awareness and Intent in Autonomous Vehicle-Pedestrian Interaction , 2018, CHI.

[21]  Adrienne Shaw,et al.  Encoding and decoding affordances: Stuart Hall and interactive media technologies , 2017 .

[22]  Jacques M. B. Terken,et al.  Gaze Patterns in Pedestrian Interaction with Vehicles: Towards Effective Design of External Human-Machine Interfaces for Automated Vehicles , 2019, AutomotiveUI.

[23]  Marjan Hagenzieker,et al.  Safe interaction between cyclists, pedestrians and automated vehicles. What do we know and what do we need to know? , 2016 .

[24]  Adam Millard-Ball,et al.  Pedestrians, Autonomous Vehicles, and Cities , 2016 .

[25]  Wendy Ju,et al.  Ghost driver: A field study investigating the interaction between pedestrians and driverless vehicles , 2016, 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[26]  Mark Colley,et al.  Towards a Design Space for External Communication of Autonomous Vehicles , 2020, CHI Extended Abstracts.

[27]  幸政 玉津,et al.  Pedestrian notification apparatus , 2012 .

[28]  Marjan P. Hagenzieker,et al.  Interactions between cyclists and automated vehicles: Results of a photo experiment* , 2019, Journal of Transportation Safety & Security.

[29]  Sowmya Somanath,et al.  Can Interfaces Facilitate Communication in Autonomous Vehicle-Pedestrian Interaction? , 2018, HRI.

[30]  Markus Rothmüller,et al.  Designing for Interactions with Automated Vehicles: Ethnography at the Boundary of Quantitative-Data-Driven Disciplines , 2018, Ethnographic Praxis in Industry Conference Proceedings.

[31]  Marcelo H. Ang,et al.  Pedestrian Notification Methods in Autonomous Vehicles for Multi-Class Mobility-on-Demand Service , 2016, HAI.

[32]  Melissa Cefkin,et al.  Developing Socially Acceptable Autonomous Vehicles , 2016 .

[33]  Malte Risto,et al.  The social behavior of autonomous vehicles , 2016, UbiComp Adjunct.

[34]  Patricia R DeLucia,et al.  Effects of Oncoming Vehicle Size on Overtaking Judgments , 2014, Accident; analysis and prevention.

[35]  Girish Chowdhary,et al.  Intent Communication between Autonomous Vehicles and Pedestrians , 2017, ArXiv.

[36]  Natasha Merat,et al.  Designing the interaction of automated vehicles with other traffic participants: A design framework based on human needs and expectations , 2018 .

[37]  Helmut Tiesler-Wittig,et al.  Functional Application, Regulatory Requirements and Their Future Opportunities for Lighting of Automated Driving Systems , 2019, SAE Technical Paper Series.

[38]  Shuchisnigdha Deb,et al.  Pedestrian Perception of Autonomous Vehicles with External Interacting Features , 2018, Advances in Intelligent Systems and Computing.

[39]  Takeo Igarashi,et al.  Adjunct Proceedings of the 10th International ACM Conference on Automotive User Interfaces and Interactive Vehicular Applications , 2018 .

[40]  Tobias Lagström,et al.  AVIP - Autonomous vehicles' interaction with pedestrians - An investigation of pedestrian-driver communication and development of a vehicle external interface , 2016 .

[41]  Chao Wang,et al.  Interface Concepts for Intent Communication from Autonomous Vehicles to Vulnerable Road Users , 2018, AutomotiveUI.

[42]  Daniel W. Carruth,et al.  Investigating pedestrian suggestions for external features on fully autonomous vehicles: A virtual reality experiment , 2018, Transportation Research Part F: Traffic Psychology and Behaviour.

[43]  Florian Alt,et al.  Investigating the Influence of External Car Displays on Pedestrians' Crossing Behavior in Virtual Reality , 2019, MobileHCI.

[44]  John T. Stasko,et al.  A taxonomy of ambient information systems: four patterns of design , 2006, AVI '06.

[45]  Andreas Riener,et al.  How Should Automated Vehicles Interact with Pedestrians?: A Comparative Analysis of Interaction Concepts in Virtual Reality , 2019, AutomotiveUI.

[46]  Natasha Merat,et al.  Understanding the Messages Conveyed by Automated Vehicles , 2019, AutomotiveUI.

[47]  Jun Hu,et al.  Driver-to-Driver Communication on the Highway: What Drivers Want , 2014, AmI.

[48]  Albrecht Schmidt,et al.  Proceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications , 2010, AutomotiveUI 2012.

[49]  Alexander G. Mirnig,et al.  Workshop on Communication between Automated Vehicles and Vulnerable Road Users , 2018, AutomotiveUI.

[50]  Azra Habibovic,et al.  SAV2P: Exploring the Impact of an Interface for Shared Automated Vehicles on Pedestrians' Experience , 2017, AutomotiveUI.

[51]  Andreas Butz,et al.  Overtrust in External Cues of Automated Vehicles: An Experimental Investigation , 2019, AutomotiveUI.

[52]  Alex Fridman,et al.  To Walk or Not to Walk: Crowdsourced Assessment of External Vehicle-to-Pedestrian Displays , 2017, ArXiv.

[53]  Nicholas Pennycooke AEVITA : designing biomimetic vehicle-to-pedestrian communication protocols for autonomously operating & parking on-road electric vehicles , 2012 .

[54]  Jun Hu,et al.  CarNote: Reducing Misunderstanding between Drivers by Digital Augmentation , 2017, IUI.

[55]  Joost C. F. de Winter,et al.  Survey on eHMI concepts: The effect of text, color, and perspective , 2019, Transportation Research Part F: Traffic Psychology and Behaviour.

[56]  Thomas Schlegel,et al.  A visual comparison of gaze behavior from pedestrians and cyclists , 2018, ETRA.

[57]  M. Griffin,et al.  The factors shaping car drivers' attitudes towards cyclist and their impact on behaviour. , 2019, Accident; analysis and prevention.

[58]  Bastian Pfleging,et al.  Color and Animation Preferences for a Light Band eHMI in Interactions Between Automated Vehicles and Pedestrians , 2020, CHI.

[59]  Martin Tomitsch,et al.  A framework for designing interactions between pedestrians and driverless cars: insights from a ride-sharing design study , 2018, OZCHI.

[60]  Jacques M. B. Terken,et al.  Pedestrian Interaction with Vehicles: Roles of Explicit and Implicit Communication , 2017, AutomotiveUI.

[61]  Frank Flemisch,et al.  Towards a dynamic balance between humans and automation: authority, ability, responsibility and control in shared and cooperative control situations , 2012, Cognition, Technology & Work.

[62]  John K. Tsotsos,et al.  Autonomous Vehicles That Interact With Pedestrians: A Survey of Theory and Practice , 2018, IEEE Transactions on Intelligent Transportation Systems.

[63]  Matthias Beggiato,et al.  An experimental study to investigate design and assessment criteria: What is important for communication between pedestrians and automated vehicles? , 2019, Applied ergonomics.

[64]  Scott M. Dittman,et al.  Monocular optical constraints on collision control. , 2001, Journal of experimental psychology. Human perception and performance.

[65]  Takeo Igarashi,et al.  Eyes on a Car: an Interface Design for Communication between an Autonomous Car and a Pedestrian , 2017, AutomotiveUI.

[66]  Debargha Dey,et al.  Pedestrian road-crossing willingness as a function of vehicle automation, external appearance, and driving behaviour , 2019, Transportation Research Part F: Traffic Psychology and Behaviour.

[67]  Mark Colley,et al.  Unveiling the Lack of Scalability in Research on External Communication of Autonomous Vehicles , 2020, CHI Extended Abstracts.

[68]  Jonas Andersson,et al.  External Vehicle Interfaces for Communication with Other Road Users? , 2018, Lecture Notes in Mobility.

[69]  Manfred Tscheligi,et al.  Control Transition Interfaces in Semiautonomous Vehicles: A Categorization Framework and Literature Analysis , 2017, AutomotiveUI.

[70]  Yahui Wang,et al.  To Cross or Not to Cross: Urgency-Based External Warning Displays on Autonomous Vehicles to Improve Pedestrian Crossing Safety , 2018, AutomotiveUI.

[71]  Sergio A. Useche,et al.  Distraction of cyclists: how does it influence their risky behaviors and traffic crashes? , 2018, PeerJ.