Improving the Detection of User Uncertainty in Automated Overtaking Maneuvers by Combining Contextual, Physiological and Individualized User Data

Highly automated driving will be a novel experience for many users and may cause uncertainty and discomfort for them [1]. An efficient real-time detection of user uncertainty during automated driving may trigger adaptation strategies, which could enhance the driving experience and subsequently the acceptance of highly automated driving [2]. In this study, we compared three different models to classify a user’s uncertainty regarding an automated vehicle’s capabilities and traffic safety during overtaking maneuvers based on experimental data from a driving-simulator study. By combining physiological, contextual and user-specific data, we trained three different deep neural networks to classify user uncertainty during overtaking maneuvers on different sets of input features. We evaluated the models based on metrics like the classification accuracy and F1 Scores. For a purely context-based model, we used features such as the Time-Headway and Time-To-Collision of cars on the opposing lane. We demonstrate how the addition of user heart rate and related physiological features can improve the classification accuracy compared to a purely context-based uncertainty model. The third model included user-specific features to account for inter-user differences regarding uncertainty in highly automated vehicles. We argue that a combination of physiological, contextual and user-specific information is important for an effectual uncertainty detection that accounts for inter-user differences.

[1]  Josef F. Krems,et al.  Comfort in automated driving: An analysis of preferences for different automated driving styles and their dependence on personality traits , 2018 .

[2]  Hans-Rüdiger Pfister,et al.  Discomfort in Automated Driving - The Disco-Scale , 2013, HCI.

[3]  Jennifer Healey,et al.  Detecting stress during real-world driving tasks using physiological sensors , 2005, IEEE Transactions on Intelligent Transportation Systems.

[4]  Kazuya Takeda,et al.  Modeling Driver Risk Perception on City Roads Using Deep Learning , 2018, IEEE Access.

[5]  Asaf Degani,et al.  An Approach for Measurement of Passenger Comfort: Real-Time Classification based on In-Cabin and Exterior Data , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[6]  Patrick Rossner,et al.  How Do You Want to be Driven? Investigation of Different Highly-Automated Driving Styles on a Highway Scenario , 2019, AHFE.

[7]  Josef F. Krems,et al.  In the Passenger Seat: Differences in the Perception of Human vs. Automated Vehicle Control and Resulting HMI Demands of Users , 2020, HCI.

[8]  Matthias Beggiato,et al.  Using Smartbands, Pupillometry and Body Motion to Detect Discomfort in Automated Driving , 2018, Front. Hum. Neurosci..

[9]  Klas Ihme,et al.  Towards User-Focused Vehicle Automation: The Architectural Approach of the AutoAkzept Project , 2020, HCI.

[10]  Josef F. Krems,et al.  Driving comfort, enjoyment and acceptance of automated driving – effects of drivers’ age and driving style familiarity , 2018, Ergonomics.

[11]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.