Control Transition Interfaces in Semiautonomous Vehicles: A Categorization Framework and Literature Analysis

Designing safe and effective systems for control transitions between human and vehicle is a difficult task, due to increased reaction times and potentially inattentive drivers. In order to respond to these difficulties, this paper presents an overview of interaction solutions for control transitions between manual and autonomous driving modes. The paper examines technology patents, as well as academic publications. The paper's first contribution is an examination of the current state of the art of control transition interfaces in automated vehicles. The paper's second contribution is the reusable categorization framework developed for this overview. The results are used to identify holes and potentials regarding control transition design, including strong focus on the system over the human, lacking fallback performance, and the potentials of effective driving mode communication. These aspects point the way towards the challenges to be solved -- together with how they might be solved -- for safe and effective control transitions.

[1]  Jin Woo Kim,et al.  The user interface based on Electromyography analysis to takeover Driving mode in autonomous vehicle , 2016, 2016 IEEE Transportation Electrification Conference and Expo, Asia-Pacific (ITEC Asia-Pacific).

[2]  Klaus Bengler,et al.  Automated Driving – Assessment of Interaction Concepts Under Real Driving Conditions , 2015 .

[3]  M. Fischer,et al.  Verfahren zur Steuerung eines Fahrzeugs mit einem ein automatisiertes, teilautomatisiertes und ein manuelles Fahren ermöglichenden Fahrerassistenzsystem , 2012 .

[4]  Frederik Diederichs,et al.  Take-Over Requests for Automated Driving , 2015 .

[5]  安德斯·海德曼,et al.  Vehicle driving system , 2005 .

[6]  Shamsi T. Iqbal,et al.  Priming Drivers before Handover in Semi-Autonomous Cars , 2017, CHI.

[7]  J·埃克马克,et al.  Method And Arrangement For Allowing Secondary Tasks During Semi-automated Driving , 2016 .

[8]  곤도 데쯔지로,et al.  Information presentation device and information presentation method , 2008 .

[9]  Wendy Ju,et al.  Take the wheel: Effects of available modalities on driver intervention , 2016, 2016 IEEE Intelligent Vehicles Symposium (IV).

[10]  Klaus Bengler,et al.  “Take over!” How long does it take to get the driver back into the loop? , 2013 .

[11]  Klaus Bengler,et al.  Take-over again: Investigating multimodal and directional TORs to get the driver back into the loop. , 2017, Applied ergonomics.

[12]  Alex Fridman,et al.  Behavioral Impact of Drivers' Roles in Automated Driving , 2016, AutomotiveUI.

[13]  Michael Weber,et al.  Autonomous driving: investigating the feasibility of car-driver handover assistance , 2015, AutomotiveUI.

[14]  W. Marsden.  I and J , 2012 .

[15]  Hermann Winner,et al.  Three Decades of Driver Assistance Systems: Review and Future Perspectives , 2014, IEEE Intelligent Transportation Systems Magazine.

[16]  Manfred Tscheligi,et al.  Towards Autonomous Cars: The Effect of Autonomy Levels on Acceptance and User Experience , 2014, AutomotiveUI.

[17]  Wendy Ju,et al.  The Push vs Pull of Information between Autonomous Cars and Human Drivers , 2014, AutomotiveUI.

[18]  Alexandra Neukum,et al.  Your Turn or My Turn?: Design of a Human-Machine Interface for Conditional Automation , 2016, AutomotiveUI.

[19]  Sabine Langlois,et al.  Designing Human-Machine Interface for Autonomous Vehicles , 2016 .

[20]  Markus Maurer,et al.  Legal consequences of an increase in vehicle automation Consolidated final report of the project group Part 1 , 2013 .

[21]  Wendy Ju,et al.  Situation awareness with different levels of automation , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[22]  Kathrin Zeeb,et al.  What determines the take-over time? An integrated model approach of driver take-over after automated driving. , 2015, Accident; analysis and prevention.

[23]  Fouad Hadj-Selem,et al.  How different mental workload levels affect the take-over control after automated driving , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[24]  Clifford Nass,et al.  Partially intelligent automobiles and driving experience at the moment of system transition , 2014, CHI.

[25]  Omer Tsimhoni,et al.  Haptic seat for automated driving: preparing the driver to take control effectively , 2015, AutomotiveUI.

[26]  Andrew L. Kun,et al.  Switching Back to Manual Driving: How Does it Compare to Simply Driving Away After Parking? , 2016, AutomotiveUI.

[27]  Kathrin Zeeb,et al.  Is take-over time all that matters? The impact of visual-cognitive load on driver take-over quality after conditionally automated driving. , 2016, Accident; analysis and prevention.

[28]  Jinwoo Kim,et al.  "Are You Ready to Take-over?": An Exploratory Study on Visual Assistance to Enhance Driver Vigilance , 2017, CHI Extended Abstracts.

[29]  Susanne Boll,et al.  Assisting Drivers with Ambient Take-Over Requests in Highly Automated Driving , 2016, AutomotiveUI.

[30]  Thomas Engel,et al.  Towards A Taxonomy of Autonomous Vehicle Handover Situations , 2016, AutomotiveUI.

[31]  Boussaad Soualmi,et al.  Augmented reality versus classical HUD to take over from automated driving: An aid to smooth reactions and to anticipate maneuvers , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[32]  Takahiro Saito,et al.  Authority transfer method from automated to manual driving via haptic shared control , 2016, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[33]  Catherine M. Burns,et al.  Autonomous Driving in the Real World: Experiences with Tesla Autopilot and Summon , 2016, AutomotiveUI.

[34]  Wendy Ju,et al.  Exploring shared control in automated driving , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[35]  J C F de Winter,et al.  Comparing spatially static and dynamic vibrotactile take-over requests in the driver seat. , 2017, Accident; analysis and prevention.

[36]  Klaus Bengler,et al.  Trust in Automation – Before and After the Experience of Take-over Scenarios in a Highly Automated Vehicle☆ , 2015 .

[37]  Wendy Ju,et al.  Emergency, Automation Off: Unstructured Transition Timing for Distracted Drivers of Automated Vehicles , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[38]  Mascha C. van der Voort,et al.  Supporting the Changing Driver’s Task: Exploration of Interface Designs for Supervision and Intervention in Automated Driving , 2016 .

[39]  Wendy Ju,et al.  Timing of unstructured transitions of control in automated driving , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[40]  Klaus Bengler,et al.  A transforming steering wheel for highly automated cars , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[41]  Thomas Maier,et al.  Driver Support by a Vibrotactile Seat Matrix – Recognition, Adequacy and Workload of Tactile Patterns in Take-over Scenarios During Automated Driving☆ , 2015 .

[42]  Markus Lienkamp,et al.  Driving in an Increasingly Automated World – Approaches to Improve the Driver-automation Interaction , 2015 .

[43]  Frank E. Pollick,et al.  Language-based multimodal displays for the handover of control in autonomous cars , 2015, AutomotiveUI.

[44]  Wendy Ju,et al.  Tunneled In: Drivers with Active Secondary Tasks Need More Time to Transition from Automation , 2017, CHI.

[45]  Ji Hyun Yang,et al.  Takeover Requests in Simulated Partially Autonomous Vehicles Considering Human Factors , 2017, IEEE Transactions on Human-Machine Systems.

[46]  Bastian Pfleging,et al.  Investigating user needs for non-driving-related activities during automated driving , 2016, MUM.

[47]  M. Nees.  Self-driving cars will need people, too , 2015 .

[48]  Frank Gauterin,et al.  Recommendations Supporting Situation Awareness in Partially Automated Driver Assistance Systems , 2015, IEEE Transactions on Intelligent Transportation Systems.

[49]  Michael Weber,et al.  Towards Cooperative Driving: Involving the Driver in an Autonomous Vehicle's Decision Making , 2016, AutomotiveUI.

[50]  芳幸 村松,et al.  Vehicle information presentation device , 2014 .