On-Road Evaluation of Autonomous Driving Training

Driver interaction with increasingly automated vehicles requires prior knowledge of system capabilities, operational know-how to use novel car equipment and responsiveness to unpredictable situations. With the purpose of getting drivers ready for autonomous driving, in a between-subject study sixty inexperienced participants were trained with an on-board video tutorial, an Augmented Reality (AR) program and a Virtual Reality (VR) simulator. To evaluate the transfer of training to real driving scenarios, a test drive on public roads was conducted implementing, for the first time in these conditions, the Wizard of Oz (WoZ) protocol. Results suggest that VR and AR training can foster knowledge acquisition and improve reaction time performance in take-over requests. Moreover, participants' behavior during the test drive highlights the ecological validity of the experiment thanks to the effective implementation of the WoZ methodology.

[1]  Klaus Bengler,et al.  “Take over!” How long does it take to get the driver back into the loop? , 2013 .

[2]  Jonas Andersson,et al.  Evaluating interactions with non-existing automated vehicles: three Wizard of Oz approaches , 2016, 2016 IEEE Intelligent Vehicles Symposium (IV).

[3]  John Vince.  Virtual Reality Techniques in Flight Simulation , 1993, Virtual Reality Systems.

[4]  Wendy Ju,et al.  Marionette: Enabling On-Road Wizard-of-Oz Autonomous Driving Studies , 2017, 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI.

[5]  M. Ott,et al.  ON IMMERSIVE VIRTUAL REALITY IN EDUCATION : STATE OF THE ART AND PERSPECTIVES , 2015 .

[6]  Josef F. Krems,et al.  Prior Familiarization With Takeover Requests Affects Drivers’ Takeover Performance and Automation Trust , 2017, Hum. Factors.

[7]  Wendy Ju,et al.  Ghost driver: A field study investigating the interaction between pedestrians and driverless vehicles , 2016, 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[8]  William Payre,et al.  Impact of training and in-vehicle task performance on manual control recovery in an automated car , 2017 .

[9]  Jorge Bacca,et al.  Augmented Reality Trends in Education: A Systematic Review of Research and Applications , 2014, J. Educ. Technol. Soc..

[10]  Taxonomy and definitions for terms related to driving automation systems for on-road motor vehicles , 2022 .

[11]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[12]  Robert S. Kennedy,et al.  Simulator Sickness Questionnaire: An enhanced method for quantifying simulator sickness. , 1993 .

[13]  Ken Goldberg,et al.  Deep Imitation Learning for Complex Manipulation Tasks from Virtual Reality Teleoperation , 2017, ICRA.

[14]  Charles A. Green,et al.  The “Out-of-the-Loop” concept in automated driving: proposed definition, measures and implications , 2018, Cognition, Technology & Work.

[15]  Franco Tecchia,et al.  Evaluating virtual reality and augmented reality training for industrial maintenance and assembly tasks , 2015, Interact. Learn. Environ..

[16]  Sotiris Makris,et al.  Augmented reality system for operator support in human–robot collaborative assembly , 2016 .

[17]  Tathagata Chakraborti,et al.  Virtual, Augmented, and Mixed Reality for Human-Robot Interaction (VAM-HRI) , 2019, HRI.

[18]  S. J. Steiner,et al.  Virtual reality and augmented reality as a training tool for assembly tasks , 1999, 1999 IEEE International Conference on Information Visualization (Cat. No. PR00210).

[19]  Isabelle Milleville-Pennel,et al.  Driving for Real or on a Fixed-Base Simulator: Is It so Different? An Explorative Study , 2015, PRESENCE: Teleoperators and Virtual Environments.

[20]  Neville A. Stanton,et al.  Takeover Time in Highly Automated Vehicles: Noncritical Transitions to and From Manual Control , 2017, Hum. Factors.

[21]  Susanne Boll,et al.  From reading to driving: priming mobile users for take-over situations in highly automated driving , 2018, MobileHCI.

[22]  N A Stanton,et al.  Transition to manual: Comparing simulator with on-road control transitions. , 2017, Accident; analysis and prevention.

[23]  Flemming Konradsen,et al.  A review of the use of virtual reality head-mounted displays in education and training , 2017, Education and Information Technologies.

[24]  Kathrin Zeeb,et al.  Is take-over time all that matters? The impact of visual-cognitive load on driver take-over quality after conditionally automated driving. , 2016, Accident; analysis and prevention.

[25]  W. Verwey,et al.  Changes in Trust after Driving Level 2 Automated Cars , 2018, Journal of Advanced Transportation.

[26]  Richard Kulpa,et al.  The Democratization of VR‐AR , 2018 .

[27]  David Whitney,et al.  Comparing Robot Grasping Teleoperation Across Desktop and Virtual Reality with ROS Reality , 2017, ISRR.

[28]  Alexis Paljic,et al.  Get ready for automated driving using Virtual Reality. , 2018, Accident; analysis and prevention.

[29]  Laurel D. Riek,et al.  Wizard of Oz studies in HRI , 2012, J. Hum. Robot Interact..

[30]  Wendy Ju,et al.  The RRADS platform: a real road autonomous driving simulator , 2015, AutomotiveUI.

[31]  L. Bainbridge.  Ironies of Automation , 1982 .

[32]  Natasha Merat,et al.  Transition to manual: driver behaviour when resuming control from a highly automated vehicle , 2014 .

[33]  Mica R. Endsley,et al.  The Out-of-the-Loop Performance Problem and Level of Control in Automation , 1995, Hum. Factors.