A Review of Non-driving-related Tasks Used in Studies on Automated Driving

Conditionally automated driving (CAD) relieves the driver from monitoring current traffic conditions. This type of driving inherently enables the driver to execute different non-driving-related tasks (NDRTs). However, the driver still must be available as a backup option. With this in mind, the classification and evaluation of various NDRTs concerning their impact on driver performance in takeover scenarios represent an important contribution toward the creation of safe CAD functions. We reviewed various NDRTs that were used in studies on automated driving. The focus was on assigning aspects of these activities (e.g., ability to visually monitor traffic, necessity of sustained attention to NDRT, etc.) to various steps of the takeover process (e.g., noticing and interpreting takeover requests), which could be impaired by the execution of the respective NDRT. This, in turn, would increase the demands on the driver with respect to managing the takeover situation.

[1]  Klaus Bengler,et al.  Highly automated driving with a decoupled steering wheel , 2014 .

[2]  Markvollrath,et al.  The influence of cruise control and adaptive cruise control on driving behaviour--a driving simulator study. , 2011, Accident; analysis and prevention.

[3]  Tzyy-Ping Jung,et al.  EEG-Based Subject- and Session-independent Drowsiness Detection: An Unsupervised Approach , 2008, EURASIP J. Adv. Signal Process..

[4]  Michael Weber,et al.  Autonomous driving: investigating the feasibility of car-driver handover assistance , 2015, AutomotiveUI.

[5]  Wendy Ju,et al.  Emergency, Automation Off: Unstructured Transition Timing for Distracted Drivers of Automated Vehicles , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[6]  Sheue-Ling Hwang,et al.  Effects of time-gap settings of adaptive cruise control (ACC) on driving performance and subjective acceptance in a bus driving simulator , 2009 .

[7]  R. Ryan,et al.  Control and information in the intrapersonal sphere: An extension of cognitive evaluation theory. , 1982 .

[8]  Naohisa Hashimoto,et al.  Measurement of Driver's Reaction Time to Failure of Steering Controller during Automatic Driving , 2005 .

[9]  Gemma Briggs,et al.  Emotionally involving telephone conversations lead to driver error and visual tunnelling , 2011 .

[10]  D. Kahneman,et al.  Attention and Effort , 1973 .

[11]  Ernst Pöppel,et al.  Effects of display position of a visual in-vehicle task on simulated driving. , 2006, Applied ergonomics.

[12]  Natasha Merat,et al.  Control Task Substitution in Semiautomated Driving , 2012, Hum. Factors.

[13]  David A. Abbink,et al.  Should Drivers Be Operating Within an Automation-Free Bandwidth? Evaluating Haptic Steering Support Systems With Different Levels of Authority , 2015, Hum. Factors.

[14]  Nadja Schömig,et al.  The Interaction Between Highly Automated Driving and the Development of Drowsiness , 2015 .

[15]  Louis Tijerina,et al.  The Effects of a Scheduled Driver Engagement Strategy in Automated Driving , 2015 .

[16]  Natasha Merat,et al.  Engaging with Highly Automated Driving: To be or Not to be in the Loop? , 2017 .

[17]  Alexandra Neukum,et al.  Secondary task engagement and vehicle automation - comparing the effects of different automation levels in an on-road experiment , 2016 .

[18]  E. Deci,et al.  Intrinsic and Extrinsic Motivations: Classic Definitions and New Directions. , 2000, Contemporary educational psychology.

[19]  Frederik Diederichs,et al.  Take-Over Requests for Automated Driving , 2015 .

[20]  Richard J. Hanowski,et al.  Driver Distraction in Commercial Vehicle Operations , 2009 .

[21]  T. Schaller,et al.  Stauassistenz – Unterstützung des Fahrers in der Quer- und Längsführung: Systementwicklung und Kundenakzeptanz , 2008 .

[22]  Frederik Naujoks,et al.  Testing Scenarios for Human Factors Research in Level 3 Automated Vehicles , 2017 .

[23]  Göran Falkman,et al.  Presenting system uncertainty in automotive UIs for supporting trust calibration in autonomous driving , 2013, AutomotiveUI.

[24]  Dick de Waard,et al.  The measurement of drivers' mental workload , 1996 .

[25]  Marieke Hendrikje Martens,et al.  Measuring distraction: the Peripheral Detection Task , 2000 .

[26]  Jeroen Breebaart,et al.  Deleted DOI: Multichannel Coding of Applause Signals , 2008 .

[27]  Jonathan Dobres,et al.  Assessing the Demands of Voice Based In-Vehicle Interfaces - Phase II Experiment 3 - 2015 Toyota Corolla , 2015 .

[28]  Monica N. Lees,et al.  Driver Distraction and Reliance: Adaptive Cruise Control in the Context of Sensor Reliability and Algorithm Limits , 2017 .

[29]  Natasha Merat,et al.  Behavioural changes in drivers experiencing highly-automated vehicle control in varying traffic conditions , 2013 .

[30]  H. Hussmann,et al.  Assessing error recognition in automated driving , 2011 .

[31]  Kathrin Zeeb,et al.  What determines the take-over time? An integrated model approach of driver take-over after automated driving. , 2015, Accident; analysis and prevention.

[32]  Eric Rodgman,et al.  The role of driver distraction in traffic crashes , 2001 .

[33]  Thomas A. Dingus,et al.  Attentional demand requirements of an automobile moving-map navigation system , 1989 .

[34]  Josef F. Krems,et al.  Effects of Take-Over Requests and Cultural Background on Automation Trust in Highly Automated Driving , 2017 .

[35]  F. Thomas Eggemeier,et al.  Workload assessment methodology. , 1986 .

[36]  Louis Tijerina,et al.  PRELIMINARY STUDIES IN HAPTIC DISPLAYS FOR REAR-END COLLISION AVOIDANCE SYSTEM AND ADAPTIVE CRUISE CONTROL SYSTEM APPLICATIONS , 2000 .

[37]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[38]  B. Oken,et al.  Vigilance, alertness, or sustained attention: physiological basis and measurement , 2006, Clinical Neurophysiology.

[39]  Daniel V. McGehee,et al.  Effects of Adaptive Cruise Control and Alert Modality on Driver Performance , 2009 .

[40]  Mark S. Young,et al.  Drive-by-wire: The case of driver workload and reclaiming control with adaptive cruise control , 1997 .

[41]  Klaus Bengler,et al.  Partially Automated Driving as a Fallback Level of High Automation , 2013 .

[42]  David B. Kaber,et al.  Situation awareness and workload in driving while using adaptive cruise control and a cell phone , 2005 .

[43]  Natasha Merat,et al.  Highly Automated Driving, Secondary Task Performance, and Driver State , 2012, Hum. Factors.

[44]  David B. Boles,et al.  The Multiple Resources Questionnaire (MRQ) , 2001 .

[45]  Markus Lienkamp,et al.  Driving in an Increasingly Automated World – Approaches to Improve the Driver-automation Interaction , 2015 .

[46]  Charles A. Green,et al.  Human Factors Issues Associated with Limited Ability Autonomous Driving Systems: Drivers’ Allocation of Visual Attention to the Forward Roadway , 2017 .

[47]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[48]  Anita Gärling,et al.  Warnings and placement positions in automobiles , 2009 .

[49]  Mary L. Cummings,et al.  MULTIPLE ALARMS AND DRIVING SITUATIONAL AWARENESS , 2005 .

[50]  Josef F. Krems,et al.  What would drivers like to know during automated driving? Information needs at different levels of automation. , 2015 .

[51]  D. Watson,et al.  Development and validation of brief measures of positive and negative affect: the PANAS scales. , 1988, Journal of personality and social psychology.

[52]  Natasha Merat,et al.  CityMobil : Human factor issues regarding highly automated vehicles on eLane , 2009 .

[53]  Alexandra Neukum,et al.  The effect of urgency of take-over requests during highly automated driving under distraction conditions , 2014 .

[54]  E. Deci.  Effects of Externally Mediated Rewards on Intrinsic Motivation. , 1971 .

[55]  Alexandra Neukum,et al.  Evaluating distraction of in-vehicle information systems while driving by predicting total eyes-off-road times with keystroke level modeling. , 2017, Applied ergonomics.

[56]  Richard J. Hanowski,et al.  An Assessment of Driver Drowsiness, Distraction, and Performance in a Naturalistic Setting , 2011 .

[57]  Catherine Neubauer,et al.  Fatigue in the Automated Vehicle , 2014 .

[58]  Thomas Maier,et al.  Driver Support by a Vibrotactile Seat Matrix – Recognition, Adequacy and Workload of Tactile Patterns in Take-over Scenarios During Automated Driving☆ , 2015 .

[59]  Lutz Lorenz,et al.  Designing take over scenarios for automated driving , 2014 .

[60]  Klaus Bengler,et al.  Ubernahmezeiten beim hochautomatisierten Autofahren , 2012 .

[61]  Klaus Bengler,et al.  How Traffic Situations and Non-Driving Related Tasks Affect the Take-Over Quality in Highly Automated Driving , 2014 .

[62]  Carryl L. Baldwin,et al.  Driver fatigue: The importance of identifying causal factors of fatigue when considering detection and countermeasure technologies , 2009 .

[63]  Frederik Naujoks,et al.  Understanding and Applying the Concept of “Driver Availability” in Automated Driving , 2017 .

[64]  Mark Vollrath,et al.  Improving the Driver–Automation Interaction , 2013, Hum. Factors.

[65]  Moritz Körber,et al.  Prediction of take-over time in highly automated driving by two psychometric tests , 2015 .

[66]  Mascha C. van der Voort,et al.  The influence of time-criticality on Situation Awareness when retrieving human control after automated driving , 2013, ITSC.

[67]  H. Pashler.  Dual-task interference in simple tasks: data and theory. , 1994, Psychological bulletin.

[68]  I. Robertson,et al.  `Oops!': Performance correlates of everyday attentional failures in traumatic brain injured and normal subjects , 1997, Neuropsychologia.

[69]  Klaus Bengler,et al.  Trust in Automation – Before and After the Experience of Take-over Scenarios in a Highly Automated Vehicle☆ , 2015 .

[70]  K. Bengler,et al.  Vigilance Decrement and Passive Fatigue Caused by Monotony in Automated Driving , 2015 .

[71]  J. Harackiewicz.  The effects of reward contingency and performance feedback on intrinsic motivation. , 1979 .

[72]  H. Marsh,et al.  Development and Validation of a Scale to Measure Optimal Experience: The Flow State Scale , 1996 .

[73]  D. Dinges,et al.  Sleep Deprivation and Vigilant Attention , 2008, Annals of the New York Academy of Sciences.

[74]  Frank E. Pollick,et al.  Language-based multimodal displays for the handover of control in autonomous cars , 2015, AutomotiveUI.

[75]  Christopher D. Wickens,et al.  The Structure of Attentional Resources , 1980 .

[76]  T. Åkerstedt,et al.  Subjective and objective sleepiness in the active individual. , 1990, The International journal of neuroscience.

[77]  A. Kramer,et al.  Physiological metrics of mental workload: A review of recent progress , 1990, Multiple-task performance.

[78]  J. Krems,et al.  The evolution of mental model, trust and acceptance of adaptive cruise control in relation to initial information , 2013 .

[79]  Stephen W. Porges,et al.  Research methods for measurement of heart rate and respiration , 1992, Biological Psychology.

[80]  N. Mackworth.  The Breakdown of Vigilance during Prolonged Visual Search 1 , 1948 .

[81]  Christina M. Rudin-Brown,et al.  BEHAVIOURAL ADAPTATION TO ADAPTIVE CRUISE CONTROL (ACC): IMPLICATIONS FOR PREVENTIVE STRATEGIES , 2004 .

[82]  Thomas A. Dingus,et al.  The Impact of Driver Inattention on Near-Crash/Crash Risk: An Analysis Using the 100-Car Naturalistic Driving Study Data , 2006 .

[83]  Albrecht Schmidt,et al.  Support for modeling interaction with automotive user interfaces , 2011, AutomotiveUI.

[84]  J. May,et al.  Eye movement indices of mental workload. , 1990, Acta psychologica.

[85]  Renaud Deborne,et al.  Evaluating the shift of control between driver and vehicle at high automation at low speed: the role of anticipation , 2014 .

[86]  A. Pauzie,et al.  A method to assess the driver mental workload: The driving activity load index (DALI) , 2008 .

[87]  Frank Lai,et al.  Fully-Automated Driving: The Road to Future Vehicles , 2017 .