Auditory warnings, signal-referent relations, and natural indicators: re-thinking theory and application.

In auditory warning design the idea of the strength of the association between sound and referent has been pivotal. Research has proceeded via constructing classification systems of signal-referent associations and then testing predictions about ease of learning of different levels of signal-referent relation strength across and within different types of auditory signal (viz., speech, abstract sounds, and auditory icons). However, progress is hampered by terminological confusions and by neglect of the cognitive contribution (viz., learning) of the person or user. Drawing upon semiotics and cognitive psychology, the authors highlight the indexical (as opposed to iconic) nature of so-called auditory icons, and the authors identify the cogniser as an indispensable element in the tripartite nature of signification. Classifications that neglect this third element, defining signal-referent relation strength only dyadically, yield results confounded by learning; classifications that correctly include the triadic relation yield research predictions that are redundant. These limitations of the standard method of constructing and testing classification systems suggest that auditory warning design must take the cognitive contribution of the user into account at an earlier stage in the design process.

[1]  David C. Nagel,et al.  Human factors in aviation , 1988 .

[2]  Judy Edworthy,et al.  Warning design : a research prospective , 1996 .

[3]  Andries F. Sanders,et al.  Elements of Human Performance: Reaction Processes and Attention in Human Skill , 1998 .

[4]  J Edworthy,et al.  Improving Auditory Warning Design: Relationship between Warning Sound Parameters and Perceived Urgency , 1991, Human factors.

[5]  M. A. Life,et al.  Simulation and the user interface , 1991 .

[6]  J. Jacko,et al.  Psychology of Computer Use: XLVI. Age-Related Differences in the Mapping of Auditory Icons to Visual Icons in Computer Interfaces for Children , 1997, Perceptual and motor skills.

[7]  Denis McKeown,et al.  Mapping Candidate Within-Vehicle Auditory Displays to Their Referents , 2007, Hum. Factors.

[8]  Stephen McAdams,et al.  Recognition of sound sources and events , 1993 .

[9]  Neville A. Stanton,et al.  Human Factors in Auditory Warnings , 1999 .

[10]  S. McAdams,et al.  Auditory Cognition. (Book Reviews: Thinking in Sound. The Cognitive Psychology of Human Audition.) , 1993 .

[11]  G. Lakoff,et al.  Metaphors We Live by , 1981 .

[12]  J Edworthy,et al.  Improving Auditory Warning Design: Quantifying and Predicting the Effects of Different Warning Parameters on Perceived Urgency , 1993, Human factors.

[13]  Bruce N. Walker,et al.  Consistency of magnitude estimations with conceptual data dimensions used for sonification , 2007 .

[14]  J. Mahon The Poetics of Mind , 1996 .

[15]  Anne Guillaume,et al.  Judging the urgency of nonvocal auditory warning signals: perceptual and cognitive processes. , 2003, Journal of experimental psychology. Applied.

[16]  J. Edworthy,et al.  On using psychophysical techniques to achieve urgency mapping in auditory warnings. , 1999, Applied ergonomics.

[17]  T. Hawkes Structuralism and Semiotics , 1977 .

[18]  A. Edwards Extra-ordinary human-computer interaction: interfaces for users with disabilities , 1995 .

[19]  Martin B. Curry,et al.  Measuring symbol and icon characteristics: Norms for concreteness, complexity, meaningfulness, familiarity, and semantic distance for 239 symbols , 1999, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[20]  J Edworthy,et al.  Auditory affordances in the intensive treatment unit. , 1998, Applied ergonomics.

[21]  R Graham,et al.  Use of auditory icons as emergency warnings: evaluation within a vehicle collision avoidance application. , 1999, Ergonomics.

[22]  Mark C. Detweiler,et al.  Iconic Reference: Evolving Perspectives and an Organizing Framework , 1993, Int. J. Man Mach. Stud..

[23]  Paul van Schaik,et al.  Designing and evaluating icons. , 2000 .

[24]  R. Woodworth,et al.  Experimental psychology, Rev. ed. , 1954 .

[25]  W H Warren,et al.  Auditory perception of breaking and bouncing events: a case study in ecological acoustics. , 1984, Journal of experimental psychology. Human perception and performance.

[26]  R. Gibbs The Poetics of Mind: Figurative Thought, Language, and Understanding , 1994 .

[27]  Oscar de Bruijn,et al.  The effects of visual information on users' mental models: an evaluation of pathfinder analysis as a measure of icon usability. , 2001 .

[28]  Thomas A. Dingus,et al.  Human Factors Field Evaluation of Automotive Headway Maintenance/Collision Warning Devices , 1997, Hum. Factors.

[29]  M. Levine The Analytic Freud: Philosophy and psychoanalysis , 2000 .

[30]  G. Lakoff,et al.  More than Cool Reason: A Field Guide to Poetic Metaphor , 1991 .

[31]  J. Hopkins Psychoanalysis, Metaphor, and The Concept of Mind , 2000 .

[32]  C. Morris,et al.  Signs, Language and Behavior , 1947 .

[33]  Jacques Maritain,et al.  Sign and Symbol , 1937, Journal of the Warburg Institute.

[34]  Paul Bouissac,et al.  Converging Parallels , 1998 .

[35]  James L. Szalma,et al.  Effects of Sensory Modality and Task Duration on Performance, Workload, and Stress in Sustained Attention , 2004, Hum. Factors.

[36]  J Edworthy,et al.  The design and implementation of non-verbal auditory warnings. , 1994, Applied ergonomics.

[37]  D. Dedrick,et al.  INDWELLING VENOUS CANNULA IN THE RAT , 1975 .

[38]  Meera Blattner,et al.  Earcons and Icons: Their Structure and Common Design Principles , 1989, Hum. Comput. Interact..

[39]  Peter Keller,et al.  Meaning from environmental sounds: types of signal-referent relations and their effect on recognizing auditory icons. , 2004, Journal of experimental psychology. Applied.

[40]  Y C Liu,et al.  Comparative study of the effects of auditory, visual and multimodality displays on drivers' performance in advanced traveller information systems , 2001, Ergonomics.

[41]  Bruce N Walker,et al.  Magnitude estimation of conceptual data dimensions for use in sonification. , 2002, Journal of experimental psychology. Applied.

[42]  A. Osman,et al.  Dimensional overlap: cognitive basis for stimulus-response compatibility--a model and taxonomy. , 1990, Psychological review.

[43]  F. Galton Exhibition of Instruments (1) for Testing Perception of Differences of Tint, and (2) for Determining Reaction-Time , 1890 .

[44]  David Shinar,et al.  Imperfect In-Vehicle Collision Avoidance Warning Systems Can Aid Drivers , 2004, Hum. Factors.

[45]  Addie Dutta,et al.  Persistence of stimulus-response compatibility effects with extended practice. , 1992, Journal of experimental psychology. Learning, memory, and cognition.

[46]  James D. Hollan,et al.  Direct Manipulation Interfaces , 1985, Hum. Comput. Interact..

[47]  DeWitt H. Parker,et al.  Philosophy in a New Key , 1941 .

[48]  R. R. Patterson,et al.  Guidelines for auditory warning systems on civil aircraft , 1982 .

[49]  D. G. MacKay,et al.  Metaphor and Thought , 1980 .

[50]  J. Ballas Common factors in the identification of an assortment of brief everyday sounds , 1993 .

[51]  E C Haas,et al.  Perceived urgency of and response time to multi-tone and frequency-modulated warning signals in broadband noise. , 1995, Ergonomics.

[52]  D R Begault,et al.  Three-dimensional audio versus head-down traffic alert and collision avoidance system displays. , 1996, The International journal of aviation psychology.

[53]  V. Ramachandran,et al.  Synaesthesia? A window into perception, thought and language , 2001 .

[54]  German Valencia,et al.  Effectiveness of Three-Dimensional Auditory Directional Cues , 1988 .

[55]  Christopher D. Wickens,et al.  12 – Aviation Displays , 1988 .

[56]  Judy Edworthy,et al.  Learning auditory warnings: The effects of sound type, verbal labelling and imagery on the identification of alarm sounds , 1999 .

[57]  Russell L. Martin,et al.  Learning and Retention of Associations Between Auditory Icons and Denotative Referents: Implications for the Design of Auditory Warnings , 2006, Hum. Factors.

[58]  William W. Gaver The SonicFinder: An Interface That Uses Auditory Icons , 1989, Hum. Comput. Interact..

[59]  William W. Gaver What in the World Do We Hear? An Ecological Approach to Auditory Event Perception , 1993 .

[60]  J. Edworthy,et al.  Alarms and human behaviour: implications for medical alarms. , 2006, British journal of anaesthesia.

[61]  Durand R. Begault,et al.  Techniques and applications for binaural sound manipulation in human-machine interfaces , 1992 .

[62]  J Edworthy,et al.  A user-centred approach to the design and evaluation of auditory warning signals: 1. Methodology. , 1995, Ergonomics.

[63]  E. A. J. Johnson,et al.  The Encyclopaedia of the Social Sciences , 1930 .

[64]  Donald A. Norman,et al.  User Centered System Design: New Perspectives on Human-Computer Interaction , 1988 .

[65]  S. Gallagher How the body shapes the mind , 2005 .

[66]  D J Folds,et al.  Auditory signals in military aircraft: ergonomics principles versus practice. , 1986, Applied ergonomics.

[67]  Jan Noyes,et al.  Human factors in civil flight deck design , 2004 .

[68]  Gary S. Robinson,et al.  A New Class of Auditory Warning Signals for Complex Systems: Auditory Icons , 1999, Hum. Factors.

[69]  T. Maung on in C , 2010 .

[70]  Russell L. Martin,et al.  Learning and retention of auditory warnings , 1997 .

[71]  Z. Kövecses,et al.  Metaphor in Culture: Universality and Variation , 2005 .

[72]  G. Lakoff The Contemporary Theory of Metaphor , 1993 .

[73]  Paul M. C. Lemmens,et al.  The effect of earcons on reaction times and error-rates in a dual-task vs. a single-task experiment , 2000 .

[74]  Nilli Lavie,et al.  Auditory attentional capture: effects of singleton distractor sounds. , 2004, Journal of experimental psychology. Human perception and performance.

[75]  A. Petocz Psychology in the Twenty-First Century: Closing the Gap between Science and the Symbol , 2001 .

[76]  T. Anderson,et al.  Binaural and spatial hearing in real and virtual environments , 1997 .

[77]  Michael S. Wogalter,et al.  Handbook of Warnings , 2006 .

[78]  C. Hartshorne,et al.  Collected Papers of Charles Sanders Peirce , 1935, Nature.

[79]  Michael W. Haas,et al.  Virtually-augmented interfaces for tactical aircraft , 1995, Biological Psychology.

[80]  Denis McKeown,et al.  Candidates for within-vehicle auditory displays , 2005 .

[81]  G. E. Cooper A SURVEY OF THE STATUS OF AND PHILOSOPHIES RELATING TO COCKPIT WARNING SYSTEMS , 1977 .

[82]  V. Aldrich,et al.  Signs, Language, and Beahavior , 1947 .

[83]  J. R. Comstock,et al.  A psychophysiological evaluation of the perceived urgency of auditory warning signals. , 1995, Ergonomics.

[84]  Pernilla Ulfvengren,et al.  Design of Natural Warning Sounds in Human-Machine Systems , 2003 .

[85]  M. Wheeler Reconstructing the Cognitive World: The Next Step , 2005 .

[86]  William W. Gaver Auditory Icons: Using Sound in Computer Interfaces , 1986, Hum. Comput. Interact..

[87]  Martin B. Curry,et al.  Exploring the effects of icon characteristics on user performance: the role of icon concreteness, complexity, and distinctiveness. , 2000, Journal of experimental psychology. Applied.

[88]  R Hétu,et al.  Audibility and identification of auditory alarms in the operating room and intensive care unit. , 1993, Ergonomics.