S(C)ENTINEL: monitoring automated vehicles with olfactory reliability displays

Overreliance in technology is safety-critical and it is assumed that this could have been a main cause of severe accidents with automated vehicles. To ease the complex task of permanently monitoring vehicle behavior in the driving environment, researchers have proposed to implement reliability/uncertainty displays. Such displays allow to estimate whether or not an upcoming intervention is likely. However, presenting uncertainty just adds more visual workload on drivers, who might also be engaged in secondary tasks. We suggest to use olfactory displays as a potential solution to communicate system uncertainty and conducted a user study (N=25) in a high-fidelity driving simulator. Results of the experiment (conditions: no reliability display, purely visual reliability display, and visual-olfactory reliability display) comping both objective (task performance) and subjective (technology acceptance model, trust scales, semi-structured interviews) measures suggest that olfactory notifications could become a valuable extension for calibrating trust in automated vehicles.

[1]  B. Raudenbush,et al.  Effects of Peppermint and Cinnamon Odor Administration on Simulated Driving Alertness, Mood and Workload , 2009 .

[2]  Richard Corbett,et al.  AROMA: ambient awareness through olfaction in a messaging application , 2004, ICMI '04.

[3]  T. Atsumi,et al.  Smelling lavender and rosemary increases free radical scavenging activity and decreases cortisol level in saliva , 2007, Psychiatry Research.

[4]  E. Heuberger,et al.  The influence of essential oils on human attention. I: alertness. , 2001, Chemical senses.

[5]  Susanne Boll,et al.  Supporting lane change decisions with ambient light , 2015, AutomotiveUI.

[6]  Chi Thanh Vi,et al.  What Did I Sniff?: Mapping Scents Onto Driving-Related Messages , 2017, AutomotiveUI.

[7]  P. Desmet,et al.  Framework of product experience , 2007 .

[8]  R. Dolan,et al.  The Nose Smells What the Eye Sees Crossmodal Visual Facilitation of Human Olfactory Perception , 2003, Neuron.

[9]  Enrico Tronci.  1997 , 1997, Les 25 ans de l’OMC: Une rétrospective en photos.

[10]  Lisanne Bainbridge,et al.  Ironies of automation , 1982, Autom..

[11]  Yasuyuki Yanagida,et al.  Stimulation effects provided to drivers by fragrance presentation considering olfactory adaptation , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[12]  Marianna Obrist,et al.  I Smell Trouble: Using Multiple Scents To Convey Driving-Relevant Information , 2018, ICMI.

[13]  Judith Amores,et al.  Essence: Olfactory Interfaces for Unconscious Influence of Mood and Cognitive Performance , 2017, International Conference on Human Factors in Computing Systems.

[14]  A. Dittmar,et al.  Basic Emotions Evoked by Odorants Comparison Between Autonomic Responses and Self-Evaluation , 1997, Physiology & Behavior.

[15]  Ann M. Bisantz,et al.  Utilizing Graphical Formats to Convey Uncertainty in a Decision Making Task , 2000 .

[16]  Chi Thanh Vi,et al.  A Comparison of Scent-Delivery Devices and Their Meaningful Use for In-Car Olfactory Interaction , 2016, AutomotiveUI.

[17]  D. Watson,et al.  Development and validation of brief measures of positive and negative affect: the PANAS scales. , 1988, Journal of personality and social psychology.

[18]  R. Baron,et al.  Effects of a Pleasant Ambient Fragrance on Simulated Driving Performance: The Sweet Smell of … Safety? , 1996 .

[19]  M. Endsley.  Autonomous Driving Systems: A Preliminary Naturalistic Study of the Tesla Model S , 2017 .

[20]  Shin Yamamoto,et al.  Study on Stimulation Effects for Driver Based on Fragrance Presentation , 2011, MVA.

[21]  Bruce N. Walker,et al.  Development and Preliminary Evaluation of Reliability Displays for Automated Lane Keeping , 2017, AutomotiveUI.

[22]  Gabriel-Miro Muntean,et al.  Olfaction-Enhanced Multimedia Synchronization , 2018, MediaSync, Handbook on Multimedia Synchronization.

[23]  Leslie M Kay,et al.  Olfactory Coding: Random Scents Make Sense , 2011, Current Biology.

[24]  Marianna Obrist,et al.  OSpace: Towards a Systematic Exploration of Olfactory Interaction Spaces , 2017, ISS.

[25]  Philipp Wintersberger,et al.  Trust in Technology as a Safety Aspect in Highly Automated Driving , 2016, i-com.

[26]  Peter R. Nelson,et al.  Multiple Comparisons: Theory and Methods , 1997 .

[27]  Shun'ichi Doi,et al.  Study of olfactory effect on individual driver under driving , 2009, 2009 ICME International Conference on Complex Medical Engineering.

[28]  Sharon L. Wolchik.  1989 , 2009 .

[29]  Torben Wallbaum,et al.  Comparing Shape-Changing and Vibro-Tactile Steering Wheels for Take-Over Requests in Highly Automated Driving , 2017, AutomotiveUI.

[30]  Enrico Rukzio,et al.  inScent: a wearable olfactory display as an amplification for mobile notifications , 2017, SEMWEB.

[31]  Masooda Bashir,et al.  Trust in Automation , 2015, Hum. Factors.

[32]  Pramodita Sharma.  2012 , 2013, Les 25 ans de l’OMC: Une rétrospective en photos.

[33]  Stanley Lemeshow,et al.  Olfactory influences on mood and autonomic, endocrine, and immune function , 2008, Psychoneuroendocrinology.

[34]  A. James.  2010 , 2011, Philo of Alexandria: an Annotated Bibliography 2007-2016.

[35]  R. Herz.  Olfaction, Taste, and Cognition: Influences of Odors on Mood and Affective Cognition , 2002 .

[36]  T. Hongratanaworakit.  Relaxing Effect of Rose Oil on Humans , 2009, Natural product communications.

[37]  Raja Parasuraman,et al.  Humans and Automation: Use, Misuse, Disuse, Abuse , 1997, Hum. Factors.

[38]  Stephen A. Brewster,et al.  Evaluation of Haptic Patterns on a Steering Wheel , 2016, AutomotiveUI.

[39]  Frank E. Pollick,et al.  To Beep or Not to Beep?: Comparing Abstract versus Language-Based Multimodal Driver Displays , 2015, CHI.

[40]  Joel Johansson,et al.  Automation Expectation Mismatch: Incorrect Prediction Despite Eyes on Threat and Hands on Wheel , 2018, Hum. Factors.

[41]  Bonnie M. Muir,et al.  Trust Between Humans and Machines, and the Design of Decision Aids , 1987, Int. J. Man Mach. Stud..

[42]  Matthew Turk,et al.  Multimodal interaction: A review , 2014, Pattern Recognit. Lett..

[43]  J. Price.  29 – Olfactory System , 1990 .

[44]  Alan R. Wagner,et al.  Overtrust in the robotic age , 2018, Commun. ACM.

[45]  Wendy Ju,et al.  Why did my car just do that? Explaining semi-autonomous driving actions to improve driver understanding, trust, and performance , 2014, International Journal on Interactive Design and Manufacturing (IJIDeM).

[46]  Giuseppe Carenini,et al.  What's Hot in Intelligent User Interfaces , 2016, AAAI.

[47]  A. Azzouz.  2011 , 2020, City.

[48]  M. Napierala.  What Is the Bonferroni Correction ? , 2014 .

[49]  R. Khan,et al.  Perceptual convergence of multi-component mixtures in olfaction implies an olfactory white , 2012, Proceedings of the National Academy of Sciences.

[50]  Mark R. Lehto,et al.  Foundations for an Empirically Determined Scale of Trust in Automated Systems , 2000 .

[51]  Andreas Riener,et al.  Sensor-actuator supported implicit interaction in driver assistance systems , 2010, Ausgezeichnete Informatikdissertationen.

[52]  Fred D. Davis.  User Acceptance of Information Technology: System Characteristics, User Perceptions and Behavioral Impacts , 1993, Int. J. Man Mach. Stud..

[53]  Mark Vollrath,et al.  Improving the Driver–Automation Interaction , 2013, Hum. Factors.

[54]  Göran Falkman,et al.  Presenting system uncertainty in automotive UIs for supporting trust calibration in autonomous driving , 2013, AutomotiveUI.

[55]  Philipp Wintersberger,et al.  Let Me Finish before I Take Over: Towards Attention Aware Device Integration in Highly Automated Vehicles , 2018, AutomotiveUI.

[56]  Keith Wesnes,et al.  AROMAS OF ROSEMARY AND LAVENDER ESSENTIAL OILS DIFFERENTIALLY AFFECT COGNITION AND MOOD IN HEALTHY ADULTS , 2003, The International journal of neuroscience.

[57]  Marianna Obrist,et al.  Smell-O-Message: Integration of Olfactory Notifications into a Messaging Application to Improve Users' Performance , 2018, ICMI.

[58]  Christopher Miller,et al.  Olfoto: designing a smell-based interaction , 2006, CHI.

[59]  Theresa L. White.  Memory for Odors , 1996 .

[60]  T. Engen,et al.  Odor memory: Review and analysis , 1996, Psychonomic bulletin & review.

[61]  H. Ludvigson,et al.  Effects of ambient odors of lavender and cloves on cognition, memory, affect and mood , 1989 .

[62]  John D. Lee,et al.  Trust in Automation: Designing for Appropriate Reliance , 2004, Hum. Factors.

[63]  Alexander Kunze,et al.  Augmented Reality Displays for Communicating Uncertainty Information in Automated Driving , 2018, AutomotiveUI.

[64]  S. Breznitz.  Cry Wolf: The Psychology of False Alarms , 1984 .

[65]  E. Tronci,et al.  1996 , 1997, Affair of the Heart.

[66]  H. Ehrlichman,et al.  Olfaction and Emotion , 1992 .

[67]  Philipp Wintersberger,et al.  Interactive Demo: Rapid, Live Data Supported Prototyping with U.S.E. , 2017, AutomotiveUI.

[68]  Alexander Kunze,et al.  Preliminary Evaluation of Variables for Communicating Uncertainties Using a Haptic Seat , 2018, AutomotiveUI.

[69]  H. Aarts,et al.  Smells Like Clean Spirit , 2005, Psychological science.

[70]  Robert A. Baron,et al.  Effects of a Pleasant Ambient Fragrance on Simulated Driving Performance , 1998 .

[71]  N. Sobel,et al.  Human olfaction: a constant state of change-blindness , 2010, Experimental Brain Research.

[72]  Ellen Yi-Luen Do,et al.  Season Traveller: Multisensory Narration for Enhancing the Virtual Reality Experience , 2018, CHI.

[73]  U. Castiello,et al.  Cross-modal interactions between olfaction and vision when grasping. , 2006, Chemical senses.

[74]  A. Dittmar,et al.  Basic emotions induced by odorants: a new approach based on autonomic pattern results. , 1999, Journal of the autonomic nervous system.

[75]  K. Durand,et al.  The Nose Tells it to the Eyes: Crossmodal Associations between Olfaction and Vision , 2010, Perception.

[76]  Gordon B. Davis,et al.  User Acceptance of Information Technology: Toward a Unified View , 2003, MIS Q..