Building Trust in Autonomous Vehicles: Role of Virtual Reality Driving Simulators in HMI Design

The investigation of factors contributing at making humans trust Autonomous Vehicles (AVs) will play a fundamental role in the adoption of such technology. The user's ability to form a mental model of the AV, which is crucial to establish trust, depends on effective user-vehicle communication; thus, the importance of Human-Machine Interaction (HMI) is poised to increase. In this work, we propose a methodology to validate the user experience in AVs based on continuous, objective information gathered from physiological signals, while the user is immersed in a Virtual Reality-based driving simulation. We applied this methodology to the design of a head-up display interface delivering visual cues about the vehicle's sensory and planning systems. Through this approach, we obtained qualitative and quantitative evidence that a complete picture of the vehicle's surrounding, despite the higher cognitive load, is conducive to a less stressful experience. Moreover, after having been exposed to a more informative interface, users involved in the study were also more willing to test a real AV. The proposed methodology could be extended by adjusting the simulation environment, the HMI and/or the vehicle's Artificial Intelligence modules to dig into other aspects of the user experience.

[1]  Antonello Laurino Strumenti di simulazione in realtà virtuale per la valutazione dell'esperienza utente in veicoli a guida autonoma = Virtual reality-based simulation tools for evaluating user experience in autonomous vehicles , 2018 .

[2]  Riccardo Marino,et al.  Nested PID steering control for lane keeping in autonomous vehicles , 2011 .

[3]  Fredrick Ekman,et al.  Creating Appropriate Trust in Automated Vehicle Systems: A Framework for HMI Design , 2018, IEEE Transactions on Human-Machine Systems.

[4]  Andreas Butz,et al.  Supporting Trust in Autonomous Driving , 2017 .

[5]  G. Johansson,et al.  Drivers' Brake Reaction Times , 1971, Human factors.

[6]  Xin Zhang,et al.  End to End Learning for Self-Driving Cars , 2016, ArXiv.

[7]  John D. Lee,et al.  Trust in Automation: Designing for Appropriate Reliance , 2004, Hum. Factors.

[8]  Nadia W. Mullen,et al.  Physiological responses to simulated and on-road driving. , 2011, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[9]  Norman L. Chervany,et al.  Trust and Distrust Definitions: One Bite at a Time , 2000, Trust in Cyber-societies.

[10]  Mohan M. Trivedi,et al.  A Novel Active Heads-Up Display for Driver Assistance , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[11]  Junmin Wang,et al.  Driver-Assistance Lateral Motion Control for In-Wheel-Motor-Driven Electric Ground Vehicles Subject to Small Torque Variation , 2018, IEEE Transactions on Vehicular Technology.

[12]  Anind K. Dey,et al.  Simulated augmented reality windshield display as a cognitive mapping aid for elder driver navigation , 2009, CHI.

[13]  Sidney W. A. Dekker,et al.  MABA-MABA or Abracadabra? Progress on Human–Automation Co-ordination , 2002, Cognition, Technology & Work.

[14]  Barney Dalgarno,et al.  What are the learning affordances of 3-D virtual environments? , 2010, Br. J. Educ. Technol..

[15]  Konrad Tollmar,et al.  Human-to-AI Interfaces for Enabling Future Onboard Experiences , 2017, AutomotiveUI.

[16]  R. M. Taylor,et al.  Situational Awareness Rating Technique (Sart): The Development of a Tool for Aircrew Systems Design , 2017 .

[17]  Gert Pfurtscheller,et al.  Analysis of Physiological Responses to a Social Situation in an Immersive Virtual Environment , 2006, PRESENCE: Teleoperators and Virtual Environments.

[18]  John K. Tsotsos,et al.  Autonomous Vehicles That Interact With Pedestrians: A Survey of Theory and Practice , 2018, IEEE Transactions on Intelligent Transportation Systems.

[19]  Jennifer Healey,et al.  Detecting stress during real-world driving tasks using physiological sensors , 2005, IEEE Transactions on Intelligent Transportation Systems.

[20]  Miguel Valencia,et al.  Physiological response while driving in an immersive virtual environment , 2017, 2017 IEEE 14th International Conference on Wearable and Implantable Body Sensor Networks (BSN).

[21]  Yunyi Jia,et al.  Automatic Sensor Correction of Autonomous Vehicles by Human-Vehicle Teaching-and-Learning , 2018, IEEE Transactions on Vehicular Technology.

[22]  Monica Bordegoni,et al.  Collection and comparison of driver/passenger physiologic and behavioural data in simulation and on-road driving , 2017, 2017 5th IEEE International Conference on Models and Technologies for Intelligent Transportation Systems (MT-ITS).

[23]  Judith Lynne Charlton,et al.  Simulator Validity: Behaviors Observed on the Simulator and on the Road , 2011 .

[24]  Tim Paek,et al.  Augmented reality vs. street views: a driving simulator study comparing two emerging navigation aids , 2011, Mobile HCI.

[25]  Véronique Berge-Cherfaoui,et al.  DAARIA: Driver assistance by augmented reality for intelligent automobile , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[26]  Byoung-Jun Park,et al.  Augmented reality for collision warning and path guide in a vehicle , 2015, VRST.

[27]  Robert S. Kennedy,et al.  Simulator Sickness Questionnaire: An enhanced method for quantifying simulator sickness. , 1993 .

[28]  Ryan O. Murphy,et al.  Using Skin Conductance in Judgment and Decision Making Research , 2011 .

[29]  Dongwook Kim,et al.  High-level automated driving on complex urban roads with enhanced environment representation , 2015, 2015 15th International Conference on Control, Automation and Systems (ICCAS).

[30]  Wendy Ju,et al.  Why did my car just do that? Explaining semi-autonomous driving actions to improve driver understanding, trust, and performance , 2014, International Journal on Interactive Design and Manufacturing (IJIDeM).

[31]  Michael Meehan,et al.  Physiological measures of presence in stressful virtual environments , 2002, SIGGRAPH.

[32]  Kristin E. Schaefer,et al.  Measuring Trust in Human Robot Interactions: Development of the “ Trust Perception Scale-HRI ” , 2016 .

[33]  Mexhid Ferati,et al.  Universal Design of User Interfaces in Self-driving Cars , 2017 .

[34]  Bryan Reimer,et al.  The validity of driving simulation for assessing differences between in-vehicle informational interfaces: A comparison with field testing , 2010, Ergonomics.

[35]  Martin Steinert,et al.  Capturing emotion reactivity through physiology measurement as a foundation for affective engineering in engineering design science and engineering practices , 2017, J. Intell. Manuf..

[36]  Nei Kato,et al.  Networking and Communications in Autonomous Driving: A Survey , 2019, IEEE Communications Surveys & Tutorials.

[37]  Bruno Patrão,et al.  How to Deal with Motion Sickness in Virtual Reality , 2020 .

[38]  R S Kalawsky,et al.  VRUSE--a computerised diagnostic tool: for usability evaluation of virtual/synthetic environment systems. , 1999, Applied ergonomics.

[39]  Rahul Banerjee,et al.  Assessment of Driver Stress from Physiological Signals collected under Real-Time Semi-Urban Driving Scenarios , 2014, Int. J. Comput. Intell. Syst..

[40]  Yanming Feng,et al.  Multi-vehicles interaction graph model for cooperative collision warning system , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[41]  Indira Thouvenin,et al.  Enhancing the driver awareness of pedestrian using augmented reality cues , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[42]  Enzo Pasquale Scilingo,et al.  The Role of Nonlinear Dynamics in Affective Valence and Arousal Recognition , 2012, IEEE Transactions on Affective Computing.

[43]  Mark Billinghurst,et al.  A comparative study of simulated augmented reality displays for vehicle navigation , 2016, OZCHI.

[44]  Andreas Butz,et al.  Contact-analog warnings on windshield displays promote monitoring the road scene , 2015, AutomotiveUI.

[45]  Andrea Sanna,et al.  Immersive Virtual Reality-Based Simulation to Support the Design of Natural Human-Robot Interfaces for Service Robotic Applications , 2016, AVR.