Human factors evaluation of Level 2 and Level 3 automated driving concepts

The purpose of this study was to investigate user interactions with Level 2 and Level 3 partially automated vehicles. L2 and L3 were of interest because it is at this point where the driver’s role transitions and longitudinal and lateral control are ceded in varying degrees to the vehicle. At this point, the driver becomes an intermittent operator. For L2 and L3, the level of involvement by the human might vary. Therefore, the authors use the term operator as opposed to driver. The study focused on how these intermittent operators transition between automated and non-automated vehicle operation, and how this interaction is affected by the human-machine interface (HMI). Three experiments were performed with prototype partially automated vehicles on controlled test tracks in mixed traffic. The first experiment investigated which HMI characteristics are most effective at issuing a take-over request (TOR) during the operation of an L2 automated vehicle. The second experiment investigated how to prompt operators to attend to the road when distracted during the operation of an L2 automated vehicle, and whether these prompts are effective over time. The third experiment investigated which HMI characteristics are most effective at issuing a TOR during the operation of an L3 automated vehicle. The findings suggest that the most effective hand-off strategies were those that incorporated nonvisual components. The driver engagement patterns observed in this study provide data and evidence that could support the future development of human factors design principles for L2 and L3 partially automated vehicles.

[1]  S S Stevens,et al.  HUMAN ENGINEERING FOR AN EFFECTIVE AIR-NAVIGATION AND TRAFFIC-CONTROL SYSTEM, AND APPENDIXES 1 THRU 3 , 1951 .

[2]  Thomas B. Sheridan,et al.  On How Often the Supervisor Should Sample , 1970, IEEE Trans. Syst. Sci. Cybern..

[3]  Thomas B. Sheridan,et al.  Human and Computer Control of Undersea Teleoperators , 1978 .

[4]  Mica R. Endsley,et al.  The Application of Human Factors to the Development of Expert Systems for Advanced Cockpits , 1987 .

[5]  Victor A. Riley,et al.  A General Model of Mixed-Initiative Human-Machine Systems , 1989 .

[6]  F.R.H. Zijlstra,et al.  Efficiency in work behaviour: A design approach for modern tools , 1993 .

[7]  Paul Green,et al.  PRELIMINARY HUMAN FACTORS DESIGN GUIDELINES FOR DRIVER INFORMATION SYSTEMS. FINAL REPORT , 1995 .

[8]  Clifford Nass,et al.  The media equation - how people treat computers, television, and new media like real people and places , 1996 .

[9]  Harry W. Orlady,et al.  A Methodology for Evaluating the Operational Suitability of Air Transport Flight Deck System Enhancements , 1997 .

[10]  Dick de Waard,et al.  A simple procedure for the assessment of acceptance of advanced transport telematics , 1997 .

[11]  G. Matthews,et al.  A COMPREHENSIVE QUESTIONNAIRE MEASURE OF DRIVER STRESS AND AFFECT , 1997 .

[12]  Bin Ran,et al.  Human Factor Studies in Evaluation of Automated Highway System Attributes , 1997 .

[13]  Paul J. Sherman,et al.  Aircrews’ Evaluations of Flight Deck Automation Training and Use: Measuring and Ameliorating Threats to Safety , 1997 .

[14]  Mark S. Young,et al.  Vehicle automation and driving performance , 1998 .

[15]  M R Endsley,et al.  Level of automation effects on performance, situation awareness and workload in a dynamic control task. , 1999, Ergonomics.

[16]  B. Griefahn,et al.  Zur Validität der deutschen Übersetzung des Morningness-Eveningness-Questionnaires von Horne und Östberg , 2001 .

[17]  P. Baltes,et al.  Walking While Memorizing: Age-Related Differences in Compensatory Behavior , 2001, Psychological science.

[18]  Kim J. Vicente,et al.  Ecological Interface Design: Progress and Challenges , 2002, Hum. Factors.

[19]  G. Matthews,et al.  Task-induced fatigue states and simulated driving performance , 2002, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[20]  Nadine Sarter,et al.  2. Multimodal information presentation in support of human-automation communication and coordination , 2002 .

[21]  Daniel V. McGehee,et al.  Collision Warning Timing, Driver Distraction, and Driver Response to Imminent Rear-End Collisions in a High-Fidelity Driving Simulator , 2002, Hum. Factors.

[22]  Christina M. Rudin-Brown,et al.  BEHAVIOURAL ADAPTATION TO ADAPTIVE CRUISE CONTROL (ACC): IMPLICATIONS FOR PREVENTIVE STRATEGIES , 2004 .

[23]  Catherine M. Burns,et al.  Ecological Interface Design , 2004 .

[24]  John D. Lee,et al.  Trust in Automation: Designing for Appropriate Reliance , 2004, Hum. Factors.

[25]  R. Brent Gillespie,et al.  Sharing Control Between Humans and Automation Using Haptic Interface: Primary and Secondary Task Performance Benefits , 2005, Hum. Factors.

[26]  David B. Kaber,et al.  Adaptive and Adaptable Automation Design: A Critical Review of the Literature and Recommendations for Future Research , 2006 .

[27]  J. H. Cho,et al.  DRIVER BEHAVIOR WITH ADAPTIVE CRUISE CONTROL , 2006 .

[28]  Karel Brookhuis,et al.  Consequences of automation for driver behaviour and acceptance. , 2006 .

[29]  Nadine B. Sarter,et al.  Supporting Trust Calibration and the Effective Use of Decision Aids by Presenting Dynamic System Confidence Information , 2006, Hum. Factors.

[30]  Thomas A. Dingus,et al.  The Impact of Driver Inattention on Near-Crash/Crash Risk: An Analysis Using the 100-Car Naturalistic Driving Study Data , 2006 .

[31]  Thomas B. Sheridan,et al.  Next Generation Air Transportation Systems : Human-Automation Interaction and Organizational Risks , 2006 .

[32]  Glenn F. Wilson,et al.  Performance Enhancement in an Uninhabited Air Vehicle Task Using Psychophysiologically Determined Adaptive Aiding , 2007, Hum. Factors.

[33]  Monica N. Lees,et al.  The influence of distraction and driving context on driver response to imperfect collision warning systems , 2007, Ergonomics.

[34]  Bobbie D. Seppelt,et al.  Making adaptive cruise control (ACC) limits visible , 2007, Int. J. Hum. Comput. Stud..

[35]  C Y David Yang,et al.  Evaluation of a Road-Departure Crash Warning System , 2007 .

[36]  Rob C J Ruigrok,et al.  Human factors evaluations of Free Flight Issues solved and issues remaining. , 2007, Applied ergonomics.

[37]  T. Sattel,et al.  Combining haptic human-machine interaction with predictive path planning for lane-keeping and collision avoidance systems , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[38]  Amanda K. Emo,et al.  Vehicle automation: A remedy for driver stress? , 2007, Ergonomics.

[39]  H. Hatakenaka,et al.  AHS Safety Service Utilizing an ITS On-Board Unit for Driving Support in Merging Sections , 2007 .

[40]  M. Mulder,et al.  Motivation for continuous haptic gas pedal feedback to support car following , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[41]  S.P. Hoogendoorn,et al.  Driving behavior interaction with ACC: results from a Field Operational Test in the Netherlands , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[42]  Christopher D. Wickens,et al.  Humans: Still Vital After All These Years of Automation , 2008, Hum. Factors.

[43]  Ryota Sato,et al.  Development of Distance Control Assist System with Accelerator Force Control and Braking Force Control , 2008 .

[44]  Mark Mulder,et al.  The effect of haptic guidance on curve negotiation behavior of young, experienced drivers , 2008, 2008 IEEE International Conference on Systems, Man and Cybernetics.

[45]  Ken Fernandez.  NASA and Army Collaboration on Unmanned Systems Presentation to the Association for Unmanned Vehicle Systems International (AUVSI) , 2008 .

[46]  Jessie Y.C. Chen,et al.  Effects of imperfect automation and individual differences on concurrent performance of military and robotics tasks in a simulated multitasking environment , 2009, Ergonomics.

[47]  Bobbie D. Seppelt,et al.  Human Factors in Automation Design , 2009, Handbook of Automation.

[48]  Aníbal Ollero,et al.  Automation of Mobility and Navigation , 2009, Handbook of Automation.

[49]  Marjan P. Hagenzieker,et al.  Effects of In-Car Support on Mental Workload and Driving Performance of Older Drivers , 2009, Hum. Factors.

[50]  Bobbie Danielle Seppelt,et al.  Supporting operator reliance on automation through continuous feedback , 2009 .

[51]  Steven J. Landry,et al.  Flight Deck Automation , 2009, Handbook of Automation.

[52]  Natasha Merat,et al.  CityMobil : Human factor issues regarding highly automated vehicles on eLane , 2009 .

[53]  Sheue-Ling Hwang,et al.  Effects of time-gap settings of adaptive cruise control (ACC) on driving performance and subjective acceptance in a bus driving simulator , 2009 .

[54]  Yuko J. Nakanishi,et al.  Vehicle and Road Automation , 2009, Handbook of Automation.

[55]  Luke Fletcher,et al.  Driver Inattention Detection based on Eye Gaze—Road Event Correlation , 2009, Int. J. Robotics Res..

[56]  Daniel C Murray,et al.  Analysis of Benefits and Costs of Forward Collision Warning Systems for the Trucking Industry , 2009 .

[57]  William Whittaker,et al.  Autonomous driving in urban environments: Boss and the Urban Challenge , 2008, J. Field Robotics.

[58]  Raja Parasuraman,et al.  Adaptive Automation for Human Supervision of Multiple Uninhabited Vehicles: Effects on Change Detection, Situation Awareness, and Mental Workload , 2009 .

[59]  Steven E Shladover.  Effects of Cooperative Adaptive Cruise Control on Traffic Flow: Testing Drivers' Choices of Following Distances , 2009 .

[60]  Janice Langan-Fox,et al.  Human Factors Measurement for Future Air Traffic Control Systems , 2009, Hum. Factors.

[61]  Nidhi Kalra,et al.  Liability and Regulation of Autonomous Vehicle Technologies , 2009 .

[62]  Dietrich Manzey,et al.  Impact of automated decision aids on performance, operator behaviour and workload in a simulated supervisory control task , 2009, Ergonomics.

[63]  Sebastian Thrun,et al.  Junior: The Stanford entry in the Urban Challenge , 2008, J. Field Robotics.

[64]  Annika F.L. Larsson,et al.  Issues in reclaiming control from advanced driver assistance systems , 2010 .

[65]  Markus Maurer,et al.  Stadtpilot: Driving autonomously on Braunschweig's inner ring road , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[66]  Marika Hoedemaeker,et al.  The experimental setup of a large field operational test for cooperative driving vehicles at the A270 , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[67]  Dick de Waard,et al.  Adaptive driving support: Information about the vehicle’s lateral position , 2010 .

[68]  Markus Maurer,et al.  Comprehensive treated sections in a trajectory planner for realizing autonomous driving in Braunschweig'S urban traffic , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[69]  Mark Mulder,et al.  Balancing safety and support: Changing lanes with a haptic lane-keeping support system , 2010, 2010 IEEE International Conference on Systems, Man and Cybernetics.

[70]  Raja Parasuraman,et al.  Transitioning to Future Air Traffic Management: Effects of Imperfect Automation on Controller Attention and Performance , 2010, Hum. Factors.

[71]  T. Inagaki,et al.  Traffic systems as joint cognitive systems: issues to be solved for realizing human-technology coagency , 2010, Cognition, Technology & Work.

[72]  René van Paassen,et al.  Reducing steering wheel stiffness is beneficial in supporting evasive maneuvers , 2010, 2010 IEEE International Conference on Systems, Man and Cybernetics.

[73]  Bryan Reimer,et al.  An Evaluation of Driver Reactions to New Vehicle Parking Assist Technologies Developed to Reduce Driver Stress , 2010 .

[74]  Mark Mulder,et al.  Sharing control with elderly drivers: Haptic guidance during curve negotiation , 2010, IFAC HMS.

[75]  Anthony Gerald King,et al.  Autonomous Driving - A Practical Roadmap , 2010 .

[76]  Gunnar D. Jenssen,et al.  User Acceptance of HMI Solutions for Lane Departure Warning System , 2010 .

[77]  Laura Pickup,et al.  The Operational Demand Evaluation Checklist (ODEC) of workload for railway signalling. , 2010, Applied ergonomics.

[78]  Arthur D. Fisk,et al.  Do Younger and Older Adults Differentially Depend on an Automated System? , 2010 .

[79]  Javier Sanchez,et al.  Safe Road Trains for Environment: Human Factors' Aspects in Dual Mode Transport Systems , 2010 .

[80]  Jasper J. A. Pauwelussen,et al.  Driver Behavior Analysis During ACC Activation and Deactivation in a Real Traffic Environment , 2010, IEEE Transactions on Intelligent Transportation Systems.

[81]  Raja Parasuraman,et al.  Complacency and Bias in Human Use of Automation: An Attentional Integration , 2010, Hum. Factors.

[82]  Randal O'Toole,et al.  Gridlock: Why We're Stuck in Traffic and What to Do About It , 2010 .

[83]  L. Steg,et al.  Explaining differences in acceptability before and acceptance after the implementation of a congestion charge in Stockholm , 2010 .

[84]  Luca Gatti,et al.  VIAC: An out of ordinary experiment , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[85]  David B. Kaber,et al.  Understanding Cognitive Strategy With Adaptive Automation in Dual-Task Performance Using Computational Cognitive Models , 2011 .

[86]  Justin G. Hollands,et al.  Beyond Identity: Incorporating System Reliability Information Into an Automated Combat Identification System , 2011, Hum. Factors.

[87]  Markus Maurer,et al.  Stadtpilot: First fully autonomous test drives in urban traffic , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[88]  Armin Kaussner,et al.  HAVEit Deliverable D.33.6: Validation of concept on optimum task repartition , 2011 .

[89]  Karel A Brookhuis,et al.  Effects of steering demand on lane keeping behaviour, self-reports, and physiology. A simulator study. , 2011, Accident; analysis and prevention.

[90]  Christopher D. Wickens,et al.  Informing the Design of Multimodal Displays , 2011 .

[91]  Emil P. Vlad,et al.  R&M&A&S of communication based train control systems applied to Urban Rail Transportation — A way to improve city sustainability , 2011, 2011 Proceedings - Annual Reliability and Maintainability Symposium.

[92]  Matthias Wille,et al.  Interaction of Human, Machine, and Environment in Automated Driving Systems , 2011 .

[93]  Andras Varhelyi,et al.  The effects of a driver assistance system for safe speed and safe distance - A real-life field study , 2011 .

[94]  Dietrich Manzey,et al.  Human Performance Consequences of Automated Decision Aids in States of Sleep Loss , 2011, Hum. Factors.

[95]  Mark Mulder,et al.  Correct and faulty driver support from shared haptic control during evasive maneuvers , 2011, 2011 IEEE International Conference on Systems, Man, and Cybernetics.

[96]  H. Hussmann,et al.  Assessing error recognition in automated driving , 2011 .

[97]  George Mason.  Situation Awareness, Mental Workload, and Trust in Automation:Viable, Empirically Supported Cognitive Engineering Constructs , 2011 .

[98]  Frank Flemisch,et al.  Towards a dynamic balance between humans and automation: authority, ability, responsibility and control in shared and cooperative control situations , 2012, Cognition, Technology & Work.

[99]  Mickaël Causse,et al.  Mitigation of Conflicts with Automation , 2011, Hum. Factors.

[100]  Neville A. Stanton,et al.  Detection of new in-path targets by drivers using Stop & Go Adaptive Cruise Control. , 2011, Applied ergonomics.

[101]  Mark S. Young,et al.  The impact of smart driving aids on driving performance and driver distraction , 2011 .

[102]  Gerald Matthews,et al.  Use of the RoboFlag synthetic task environment to investigate workload and stress responses in UAV operation , 2011, Behavior research methods.

[103]  Mark Mulder,et al.  Haptic shared control: smoothly shifting control authority? , 2012, Cognition, Technology & Work.

[104]  Wolfgang Spießl,et al.  Assessment and Support of Error Recognition in Automated Driving , 2011 .

[105]  Simone Benedetto,et al.  Driver workload and eye blink duration , 2011 .

[106]  Markvollrath,et al.  The influence of cruise control and adaptive cruise control on driving behaviour--a driving simulator study. , 2011, Accident; analysis and prevention.

[107]  Steven E Shladover,et al.  Recent International Activity in Cooperative Vehicle–Highway Automation Systems , 2012 .

[108]  Yulan Liang,et al.  Driver performance effects of simultaneous visual and cognitive distraction and adaptation behavior , 2012 .

[109]  Linda Ng Boyle,et al.  Use Patterns Among Early Adopters of Adaptive Cruise Control , 2012, Hum. Factors.

[110]  Jaap Ham,et al.  Trust in Smart Systems , 2012, Hum. Factors.

[111]  Joseph B. Lyons,et al.  Human–Human Reliance in the Context of Automation , 2012, Hum. Factors.

[112]  James R. Sayer,et al.  Heavy-Truck Drivers’ Following Behavior With Intervention of an Integrated, In-Vehicle Crash Warning System , 2012, Hum. Factors.

[113]  Jessie Y. C. Chen,et al.  Supervisory Control of Multiple Robots , 2012, Hum. Factors.

[114]  Sarah Sharples,et al.  Development of design principles for automated systems in transport control , 2012, Ergonomics.

[115]  Annika F L Larsson,et al.  Driver usage and understanding of adaptive cruise control. , 2012, Applied ergonomics.

[116]  Natasha Merat,et al.  Control Task Substitution in Semiautomated Driving , 2012, Hum. Factors.

[117]  Mark Mulder,et al.  Sharing Control With Haptics , 2012, Hum. Factors.

[118]  Ata M. Khan,et al.  Policy challenges of increasing automation in driving , 2012 .

[119]  Patricia Delhomme,et al.  Simulator Training With a Forward Collision Warning System , 2012, Hum. Factors.

[120]  Nico Kaempchen,et al.  Highly Automated Driving on Freeways in Real Traffic Using a Probabilistic Framework , 2012, IEEE Transactions on Intelligent Transportation Systems.

[121]  Mark Vollrath,et al.  Driving With a Partially Autonomous Forward Collision Warning System , 2012, Hum. Factors.

[122]  Alberto Broggi,et al.  The VisLab Intercontinental Autonomous Challenge: An Extensive Test for a Platoon of Intelligent Vehicles , 2012 .

[123]  M Saffarian,et al.  Why do drivers maintain short headways in fog? A driving-simulator study evaluating feeling of risk and lateral control during automated and manual car following , 2012, Ergonomics.

[124]  Meike Jipp,et al.  Effects of Observability, Mood States, and Workload on Human Handling Errors When Monitoring Aircraft Automation , 2012 .

[125]  Dick de Waard,et al.  An Adaptive Driver Support System , 2012, Hum. Factors.

[126]  Catherine Neubauer,et al.  Fatigue and Voluntary Utilization of Automation in Simulated Driving , 2012, Hum. Factors.

[127]  R. Happee,et al.  Automated Driving: Human-Factors Issues and Design Solutions , 2012 .

[128]  Bryant Walker Smith,et al.  Automated Vehicles Are Probably Legal in the United States , 2012 .

[129]  Michael C. Dorneich,et al.  Towards a Characterization of Adaptive Systems: a Framework for Researchers and System Designers , 2017 .

[130]  Marieke Hendrikje Martens,et al.  Behavioural adaptation and acceptance , 2012 .

[131]  Stephen Rice,et al.  An Expansion of System Wide Trust Theory Using In-Vehicle Automation , 2012 .

[132]  Natasha Merat,et al.  Highly Automated Driving, Secondary Task Performance, and Driver State , 2012, Hum. Factors.

[133]  Tal Oron-Gilad,et al.  The effect of system aesthetics on trust, cooperation, satisfaction and annoyance in an imperfect automated system. , 2012, Work.

[134]  Deborah Lee,et al.  I Trust It, but I Don’t Know Why , 2013, Hum. Factors.

[135]  Mary L. Cummings,et al.  Boredom and Distraction in Multiple Unmanned Vehicle Supervisory Control , 2013, Interact. Comput..

[136]  James C. Christensen,et al.  Coadaptive Aiding and Automation Enhance Operator Performance , 2013, Hum. Factors.

[137]  Christopher D. Wickens,et al.  Supporting Interruption Management and Multimodal Interface Design , 2013, Hum. Factors.

[138]  Frank Gauterin,et al.  Operationalisation of human drivers' subjective dynamics perception in automated longitudinally controlled passenger vehicles , 2013 .

[139]  Mark Vollrath,et al.  Improving the Driver–Automation Interaction , 2013, Hum. Factors.

[140]  Charles A. Green,et al.  Human Factors Issues Associated with Limited Ability Autonomous Driving Systems: Drivers’ Allocation of Visual Attention to the Forward Roadway , 2017 .

[141]  Natasha Merat,et al.  How do Drivers Behave in a Highly Automated Car , 2017 .