The Effect of Surrounding Scenery Complexity on the Transfer of Control Time in Highly Automated Driving

One challenge in highly automated driving is the safe transfer of control (ToC). A safe ToC requires estimating the take-over time depending on the driver’s state in different environmental conditions, to adapt the timing and design of the ToC request. We introduce environmental complexity as one factor that affects the ToC time. In a driving simulator experiment (N=12), the participants drove in five scenes having different environmental complexities (i.e. density and height of the background objects) with and without a secondary task. The results revealed that the ToC time is proportional to the environmental complexity. Thus, in the same driving task and the same traffic, an increasing environmental complexity yields higher ToC times in both conditions, with and without a secondary task. Our model of environmental complexity is a first step towards measuring the complexity of the real world, for a better prediction of ToC times in highly automated driving.

[1]  Shamsi T. Iqbal,et al.  Priming Drivers before Handover in Semi-Autonomous Cars , 2017, CHI.

[2]  Natasha Merat,et al.  Transition to manual: driver behaviour when resuming control from a highly automated vehicle , 2014 .

[3]  Wendy Ju,et al.  Emergency, Automation Off: Unstructured Transition Timing for Distracted Drivers of Automated Vehicles , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[4]  Klaus Bengler,et al.  Take-over again: Investigating multimodal and directional TORs to get the driver back into the loop. , 2017, Applied ergonomics.

[5]  Yuanzhen Li,et al.  Measuring visual clutter. , 2007, Journal of vision.

[6]  Philipp Wintersberger,et al.  Attentive User Interfaces to Improve Multitasking and Take-Over Performance in Automated Driving: The Auto-Net of Things , 2019, Int. J. Mob. Hum. Comput. Interact..

[7]  Susanne Boll,et al.  From reading to driving: priming mobile users for take-over situations in highly automated driving , 2018, MobileHCI.

[8]  Frank E. Pollick,et al.  Language-based multimodal displays for the handover of control in autonomous cars , 2015, AutomotiveUI.

[9]  Josef F. Krems,et al.  Situation Awareness and Secondary Task Performance While Driving , 2007, HCI.

[10]  Natasha Merat,et al.  Highly Automated Driving, Secondary Task Performance, and Driver State , 2012, Hum. Factors.

[11]  Berry Eggen,et al.  Why Disable the Autopilot? , 2018, AutomotiveUI.

[12]  M. Endsley.  Automation and situation awareness. , 1996 .

[13]  Klaus Bengler,et al.  Utilization of Drivetime – Performing Non-Driving Related Tasks While Driving Highly Automated , 2015 .

[14]  Barry A. T. Brown,et al.  The normal natural troubles of driving with GPS , 2012, CHI.

[15]  Andreas Butz,et al.  Supporting Trust in Autonomous Driving , 2017 .

[16]  Bastian Pfleging,et al.  Investigating user needs for non-driving-related activities during automated driving , 2016, MUM.

[17]  T. Hugh Woo,et al.  INFLUENCE OF MOBILE PHONE USE WHILE DRIVING : THE EXPERIENCE IN TAIWAN , 2001 .

[18]  Yili Liu,et al.  Investigation of Driver Performance With Night Vision and Pedestrian Detection Systems—Part I: Empirical Study on Visual Clutter and Glance Behavior , 2010, IEEE Transactions on Intelligent Transportation Systems.

[19]  Neville A. Stanton,et al.  Take-Over Time in Highly Automated Vehicles , 2018, Driver Reactions to Automated Vehicles.

[20]  Stephan Winter,et al.  Landmarks: GIScience for Intelligent Services , 2014 .

[21]  Wendy Ju,et al.  Don't Be Alarmed: Sonifying Autonomous Vehicle Perception to Increase Situation Awareness , 2018, AutomotiveUI.

[22]  Klaus Bengler,et al.  Taking Over Control from Highly Automated Vehicles , 2014 .

[23]  Michael Weber,et al.  Autonomous driving: investigating the feasibility of car-driver handover assistance , 2015, AutomotiveUI.

[24]  Manfred Tscheligi,et al.  What We Can Learn from Pilots for Handovers and (De)Skilling in Semi-Autonomous Driving: An Interview Study , 2017, AutomotiveUI.

[25]  Wendy Ju,et al.  Why did my car just do that? Explaining semi-autonomous driving actions to improve driver understanding, trust, and performance , 2014, International Journal on Interactive Design and Manufacturing (IJIDeM).

[26]  Matthew S. Brown,et al.  Effects of Conversation on Situation Awareness and Working Memory in Simulated Driving , 2014, Hum. Factors.

[27]  Susanne Boll,et al.  Assisting Drivers with Ambient Take-Over Requests in Highly Automated Driving , 2016, AutomotiveUI.

[28]  Natasha Merat,et al.  Control Task Substitution in Semiautomated Driving , 2012, Hum. Factors.

[29]  Christian Müller,et al.  How Machine Perception Relates to Human Perception: Visual Saliency and Distance in a Frame-by-Frame Semantic Segmentation Task for Highly/Fully Automated Driving , 2018, 2018 IEEE/ACM 1st International Workshop on Software Engineering for AI in Autonomous Systems (SEFAIAS).

[30]  Klaus Bengler,et al.  “Take over!” How long does it take to get the driver back into the loop? , 2013 .

[31]  Vidya Setlur,et al.  DriveSense: Contextual handling of large-scale route map data for the automobile , 2013, 2013 IEEE International Conference on Big Data.

[32]  John D. Lee,et al.  Driver Distraction : Theory, Effects, and Mitigation , 2008 .

[33]  Lewis L. Chuang,et al.  Take-over requests during highly automated driving: How should they be presented and under what conditions? , 2019, Transportation Research Part F: Traffic Psychology and Behaviour.

[34]  Christopher D. Wickens,et al.  Driving and Side Task Performance: The Effects of Display Clutter, Separation, and Modality , 2004, Hum. Factors.

[35]  Anne T McCartt,et al.  Cell Phones and Driving: Review of Research , 2006, Traffic injury prevention.

[36]  K A Brookhuis,et al.  The effects of mobile telephoning on driving performance. , 1991, Accident; analysis and prevention.

[37]  Tina Mioch,et al.  Driver Readiness Model for Regulating the Transfer from Automation to Human Control , 2017, IUI.

[38]  Johan Engström,et al.  Sensitivity of eye-movement measures to in-vehicle task difficulty , 2005 .

[39]  Klaus Bengler,et al.  Ubernahmezeiten beim hochautomatisierten Autofahren , 2012 .

[40]  Kathrin Zeeb,et al.  What determines the take-over time? An integrated model approach of driver take-over after automated driving. , 2015, Accident; analysis and prevention.

[41]  Albrecht Schmidt,et al.  Shifting Gears: User Interfaces in the Age of Autonomous Driving , 2016, IEEE Pervasive Computing.

[42]  X. Jessie Yang,et al.  From Manual Driving to Automated Driving: A Review of 10 Years of AutoUI , 2019, AutomotiveUI.

[43]  Shamsi T. Iqbal,et al.  Interrupted by my car? Implications of interruption and interleaving research for automated vehicles , 2019, Int. J. Hum. Comput. Stud..

[44]  Heinrich H. Bülthoff,et al.  Feel the Movement: Real Motion Influences Responses to Take-over Requests in Highly Automated Vehicles , 2018, CHI.