Improving Driver Emotions with Affective Strategies

Drivers in negative emotional states, such as anger or sadness, are prone to perform bad at driving, decreasing overall road safety for all road users. Recent advances in affective computing, however, allow for the detection of such states and give us tools to tackle the connected problems within automotive user interfaces. We see potential in building a system which reacts upon possibly dangerous driver states and influences the driver in order to drive more safely. We compare different interaction approaches for an affective automotive interface, namely Ambient Light, Visual Notification, a Voice Assistant, and an Empathic Assistant. Results of a simulator study with 60 participants (30 each with induced sadness/anger) indicate that an emotional voice assistant with the ability to empathize with the user is the most promising approach as it improves negative states best and is rated most positively. Qualitative data also shows that users prefer an empathic assistant but also resent potential paternalism. This leads us to suggest that digital assistants are a valuable platform to improve driver emotions in automotive environments and thereby enable safer driving.

[1]  J. Russell.  A circumplex model of affect. , 1980 .

[2]  M H Strobl.  SPIDER - Das innovative Software-Framework der BMW Fahrsimulation / SPIDER - The innovative software framework of the BMW driving simulation , 2003 .

[3]  A. Pauzie,et al.  A method to assess the driver mental workload: The driving activity load index (DALI) , 2008 .

[4]  Heinrich Hußmann,et al.  Adjunct Proceedings of the 10th International ACM Conference on Automotive User Interfaces and Interactive Vehicular Applications , 2018 .

[5]  Jun Hu,et al.  "Likes" and "Dislikes" on the Road: A Social Feedback System for Improving Driving Behavior , 2016, AutomotiveUI.

[6]  Myounghoon Jeon,et al.  Don’t Cry While You’re Driving: Sad Driving Is as Bad as Angry Driving , 2016, Int. J. Hum. Comput. Interact..

[7]  Alireza Sahami Shirazi,et al.  Investigating User Needs for Bio-sensing and Affective Wearables , 2016, CHI Extended Abstracts.

[8]  Bastian Pfleging.  (Non-) Driving-Related Activities in the Car: Defining Driver Activities for Manual and Automated Driving , 2015 .

[9]  Shamsi T. Iqbal,et al.  Challenges for designing notifications for affective computing systems , 2016, UbiComp Adjunct.

[10]  Taemie Jung Kim,et al.  Dynamic speedometer: dashboard redesign to discourage drivers from speeding , 2005, CHI EA '05.

[11]  G. Tonello,et al.  The Influence of Light on Mood , 2015 .

[12]  Mark A. Neerincx,et al.  Attuning In-Car User Interfaces to the Momentary Cognitive Load , 2007, HCI.

[13]  Elisabeth Schmidt,et al.  Correlation between subjective driver state measures and psychophysiological and vehicular data in simulated driving , 2016, 2016 IEEE Intelligent Vehicles Symposium (IV).

[14]  Paul A. Green.  Standard definitions for driving measures and statistics: overview and status of recommended practice J2944 , 2013, AutomotiveUI.

[15]  Elisabeth Schmidt,et al.  Evaluating Drivers’ States in Sleepiness Countermeasures Experiments Using Physiological and Eye Data – Hybrid Logistic and Linear Regression Model , 2017 .

[16]  M. Perone.  Negative effects of positive reinforcement , 2003, The Behavior analyst.

[17]  Myounghoon Jeon,et al.  The Effects of Various Music on Angry Drivers' Subjective, Behavioral, and Physiological States , 2016, AutomotiveUI.

[18]  Daniel McDuff,et al.  AutoEmotive: bringing empathy to the driving experience to manage stress , 2014, DIS Companion '14.

[19]  Stephen H. Fairclough,et al.  Fundamentals of physiological computing , 2009, Interact. Comput..

[20]  Florian Alt,et al.  Affective Assistants: A Matter of States and Traits , 2019, CHI Extended Abstracts.

[21]  Myounghoon Jeon,et al.  Towards affect-integrated driving behaviour research , 2015 .

[22]  Florian Alt,et al.  User Experience of Driver State Visualizations: A Look at Demographics and Personalities , 2019, INTERACT.

[23]  Albrecht Schmidt,et al.  A Model Relating Pupil Diameter to Mental Workload and Lighting Conditions , 2016, CHI.

[24]  Ronald Schroeter,et al.  CoastMaster: An Ambient Speedometer to Gamify Safe Driving , 2016, AutomotiveUI.

[25]  Karin Ackermann,et al.  The Nature Of Emotion Fundamental Questions , 2016 .

[26]  Myounghoon Jeon,et al.  An angry driver is not the same as a fearful driver: effects of specific negative emotions on risk perception, driving performance, and workload , 2011, AutomotiveUI.

[27]  Bryan Reimer,et al.  Monitoring, managing, and motivating driver safety and well-being , 2011, IEEE Pervasive Computing.

[28]  P. Kuppens,et al.  Regulating positive and negative emotions in daily life. , 2008, Journal of personality.

[29]  Clifford Nass,et al.  Emotion regulation for frustrating driving contexts , 2011, CHI.

[30]  Christian Wolff,et al.  Human modeling in a driver analyzing context: challenge and benefit , 2011, AutomotiveUI.

[31]  K. A. BROOKHUIS,et al.  Criteria for driver impairment , 2003, Ergonomics.

[32]  Manfred Tscheligi,et al.  Experience Maps: Experience-Enhanced Routes for Car Navigation , 2014, AutomotiveUI.

[33]  Florian Alt,et al.  A Comparison of Emotion Elicitation Methods for Affective Driving Studies , 2018, AutomotiveUI.

[34]  Anshul Sharma,et al.  A method to infer emotions from facial Action Units , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[35]  D. Byrne,et al.  Similarity and awareness of similarity of personality characteristics as determinants of attraction. , 1969 .

[36]  Clifford Nass,et al.  Improving automotive safety by pairing driver emotion and car voice emotion , 2005, CHI Extended Abstracts.

[37]  Christine L. Lisetti,et al.  Multimodal affective driver interfaces for future cars , 2002, MULTIMEDIA '02.

[38]  D. Guttfreund,et al.  The effects of written autobiographical recollection induction procedures on mood. , 1993, Journal of clinical psychology.

[39]  Stephen H. Fairclough,et al.  The Effects of Ambient Blue Light on Anger Levels: Applications in the Design of Unmanned Aircraft GCS , 2017 .

[40]  Kenton Williams,et al.  Affective Robot Influence on Driver Adherence to Safety, Cognitive Load Reduction and Sociability , 2014, AutomotiveUI.

[41]  Myounghoon Jeon,et al.  If You're Angry, Turn the Music on: Music Can Mitigate Anger Effects on Driving Performance , 2014, AutomotiveUI.

[42]  Myounghoon Jeon,et al.  Emotions in Driving , 2017 .

[43]  Manfred Tscheligi,et al.  Acceptance of future persuasive in-car interfaces towards a more economic driving behaviour , 2009, AutomotiveUI.

[44]  Richard Young,et al.  Effect of emotional speech tone on driving from lab to road: fMRI and ERP studies , 2010, AutomotiveUI.

[45]  R. Yerkes,et al.  The relation of strength of stimulus to rapidity of habit‐formation , 1908 .

[46]  Daniel M. Johnson,et al.  Designing Gamified Applications that Make Safe Driving More Engaging , 2017, CHI.

[47]  Frank Pallas,et al.  Technology paternalism – wider implications of ubiquitous computing , 2005, Poiesis Prax..

[48]  Ying Wang,et al.  Recognizing and Releasing Drivers' Negative Emotions by Using Music: Evidence from Driver Anger , 2016, AutomotiveUI.

[49]  Bryan Reimer,et al.  The validity of driving simulation for assessing differences between in-vehicle informational interfaces: A comparison with field testing , 2010, Ergonomics.

[50]  Ronald Schroeter,et al.  Pokémon DRIVE: towards increased situational awareness in semi-automated driving , 2016, OZCHI.

[51]  Elisabeth Schmidt,et al.  Mitigating passive fatigue during monotonous drives with thermal stimuli: Insights into the effect of different stimulation durations. , 2017, Accident; analysis and prevention.

[52]  Björn W. Schuller,et al.  Emotion on the Road - Necessity, Acceptance, and Feasibility of Affective Computing in the Car , 2010, Adv. Hum. Comput. Interact..

[53]  Ignacio Alvarez,et al.  Driver in the Loop: Best Practices in Automotive Sensing and Feedback Mechanisms , 2017 .

[54]  Tom Gross,et al.  The Effects of Situational Demands on Gaze, Speech and Gesture Input in the Vehicle , 2017, AutomotiveUI.

[55]  P. Valdez,et al.  Effects of color on emotions. , 1994, Journal of experimental psychology. General.

[56]  Daniel McDuff,et al.  Designing emotionally sentient agents , 2018, Commun. ACM.

[57]  Florian Alt,et al.  A Survey to Understand Emotional Situations on the Road and What They Mean for Affective Automotive UIs , 2018, Multimodal Technologies and Interaction.

[58]  Gerhard Rigoll,et al.  Bimodal fusion of emotional data in an automotive environment , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[59]  R. Steyer,et al.  States and traits in psychological assessment. , 1992 .