The Effects of Modality, Urgency and Message Content on Responses to Multimodal Driver Displays

This work investigates the design and use of multimodal displays for the car. Driver cues that vary in urgency as well as message content and use the audio, tactile and visual modalities in all their unimodal and multimodal combinations have been designed and evaluated. The goal is to investigate how such displays can effectively alert drivers without distracting. This will form the basis for creating an algorithm using multimodal displays to inform drivers, based on warning design and characteristics of the driving task. A set of experiments conducted and planned in order to better understand this subject are described in this paper.

[1]  Frank E. Pollick,et al.  Speech Tactons Improve Speech Warnings for Drivers , 2014, AutomotiveUI.

[2]  Carryl L. Baldwin.  Verbal collision avoidance messages during simulated driving: perceived urgency, alerting effectiveness and annoyance , 2011, Ergonomics.

[3]  Antti Pirhonen,et al.  Leaping across Modalities: Speed Regulation Messages in Audio and Tactile Domains , 2010, HAID.

[4]  Carryl L. Baldwin,et al.  Equating Perceived Urgency Across Auditory, Visual, and Tactile Signals , 2012 .

[5]  Carryl L. Baldwin,et al.  Perceived urgency mapping across modalities within a driving context. , 2014, Applied Ergonomics.

[6]  Carryl L. Baldwin,et al.  Perceived Urgency, Alerting Effectiveness and Annoyance of Verbal Collision Avoidance System Messages , 2002 .

[7]  Carryl L. Baldwin,et al.  Multimodal urgency coding: auditory, visual, and tactile parameters and their impact on perceived urgency. , 2012, Work.

[8]  Anton Nijholt,et al.  Evaluating informative auditory and tactile cues for in-vehicle information systems , 2010, AutomotiveUI.

[9]  Carryl L. Baldwin,et al.  Perceived Urgency Scaling in Tactile Alerts , 2012 .

[10]  Judy Edworthy,et al.  Comparing Speech and Nonspeech Warnings , 2000 .

[11]  Rob Gray,et al.  A Comparison of Different Informative Vibrotactile Forward Collision Warnings: Does the Warning Need to Be Linked to the Collision Event? , 2014, PloS one.

[12]  Denis McKeown,et al.  Mapping Candidate Within-Vehicle Auditory Displays to Their Referents , 2007, Hum. Factors.

[13]  Cristy Ho,et al.  Multisensory In-Car Warning Signals for Collision Avoidance , 2007, Hum. Factors.

[14]  Anders Lindgren,et al.  Driver behaviour when using an integrated advisory warning display for advanced driver assistance systems , 2009 .

[15]  Roope Raisamo,et al.  Tactile Modulation of Emotional Speech Samples , 2012, Adv. Hum. Comput. Interact..

[16]  John D. Lee,et al.  Alerts for In-Vehicle Information Systems: Annoyance, Urgency, and Appropriateness , 2007, Hum. Factors.

[17]  Hong Z. Tan,et al.  Using spatial vibrotactile cues to direct visual attention in driving scenes , 2005 .

[18]  Frank E. Pollick,et al.  Evaluating multimodal driver displays of varying urgency , 2013, AutomotiveUI.

[19]  Thomas J Triggs,et al.  Driver distraction: the effects of concurrent in-vehicle tasks, road environment complexity and age on driving performance. , 2006, Accident; analysis and prevention.

[20]  C. Spence,et al.  Assessing the effectiveness of various auditory cues in capturing a driver's visual attention. , 2005, Journal of experimental psychology. Applied.

[21]  J Edworthy,et al.  Improving Auditory Warning Design: Relationship between Warning Sound Parameters and Perceived Urgency , 1991, Human factors.

[22]  Frank E. Pollick,et al.  Evaluating multimodal driver displays under varying situational urgency , 2014, CHI.

[23]  Judy Edworthy,et al.  The Perceived Urgency of Speech Warnings: Semantics versus Acoustics , 2002, Hum. Factors.