Designing for Attention With Sound: Challenges and Extensions to Ecological Interface Design

Objective: We explore whether ecological interface design (EID) principles can be applied to the design of an auditory display for anesthesia monitoring. Background: EID examples focus almost exclusively on visual displays. In the anesthesia work environment, however, auditory displays may provide better individual and team awareness of patient state. Method: Using a work domain analysis of physiological monitoring in anesthesia, we identify information to display. Using the skills, rules, and knowledge distinction we identify cognitive control needed. Using semantic mapping we map physiological variables and constraints to auditory dimensions. Results: EID principles do not address when information should be displayed and to whom. An attentional mapping stage helps to specify answers to these questions so that a workable auditory display for anesthesia monitoring is achieved. Conclusion: EID principles of representing work domain functional structure and minimizing resource-demanding cognitive control are necessary but insufficient to specify requirements for an effective auditory display. Also needed are analyses of control tasks, strategies, and the social organization of work. Such analyses are an integral part of the broader cognitive work analysis framework from which EID emerged. Application: Actual or potential uses of this research include the design of displays that support continuous peripheral awareness in collaborative multimodal work environments.

[1]  Frank Drews,et al.  Research Paper: The Employment of an Iterative Design Process to Develop a Pulmonary Graphical Display , 2003, J. Am. Medical Informatics Assoc..

[2]  Catherine M. Burns,et al.  Modeling a medical environment: an ontology for integrated medical informatics design , 2001, Int. J. Medical Informatics.

[3]  J. Tinker,et al.  Role of monitoring devices in prevention of anesthetic mishaps: a closed claims analysis. , 1989, Anesthesiology.

[4]  Gunnar Johannsen,et al.  Auditory displays in human-machine interfaces , 2004, Proceedings of the IEEE.

[5]  Dwayne R. Westenskow,et al.  Integration of monitoring for intelligent alarms in anesthesia: Neural networks—Can they help? , 2005, Journal of Clinical Monitoring.

[6]  Kim J. Vicente,et al.  Ecological interface design: theoretical foundations , 1992, IEEE Trans. Syst. Man Cybern..

[7]  William W. Gaver.  Auditory Icons: Using Sound in Computer Interfaces , 1986, Hum. Comput. Interact..

[8]  Catherine M. Burns,et al.  Ecological Interface Design , 2004 .

[9]  W. J. Russell,et al.  The Australian Incident Monitoring Study. Which monitor? An analysis of 2000 incident reports. , 1993, Anaesthesia and intensive care.

[10]  Richard I. Cook,et al.  SPECIAL SECTION: Adapting to New Technology in the Operating Room , 1996, Hum. Factors.

[11]  J. S. Gravenstein.  Monitoring im anästhesiologischen Alltag , 1998, Der Anaesthesist.

[12]  Nadine B. Sarter,et al.  The Need for Multisensory Interfaces in Support of Effective Attention Allocation in Highly Dynamic Event-Driven Domains: The Case of Cockpit Automation , 2000 .

[13]  Kim J. Vicente,et al.  Ecological Interface Design: Progress and Challenges , 2002, Hum. Factors.

[14]  Penelope M. Sanderson,et al.  The Role of Auditory Attention and Auditory Perception in the Design of Real-Time Sonification of Anaesthesia Variables , 2002 .

[15]  William W. Gaver,et al.  Effective sounds in complex systems: the ARKOLA simulation , 1991, CHI.

[16]  Robert G Loeb,et al.  A laboratory evaluation of an auditory display designed to enhance intraoperative monitoring. , 2002, Anesthesia and analgesia.

[17]  Penelope M. Sanderson,et al.  Work domain analysis and sensors I: principles and simple example , 2002 .

[18]  George T Blike,et al.  Teamwork and collaboration in critical care: lessons from the cockpit. , 2003, Critical care medicine.

[19]  Stephen Brewster,et al.  A Detailed Investigation into the Effectiveness of Earcons , 1997 .

[20]  Kevin B. Bennett,et al.  An Evaluation of a "Time Tunnel" Display Format for the Presentation of Temporal Information , 2005, Hum. Factors.

[21]  Gregory Kramer,et al.  Pitch and loudness interact in auditory displays: can the data get lost in the map? , 2002, Journal of experimental psychology. Applied.

[22]  R. K. Webb,et al.  The Pulse Oximeter: Applications and Limitations—An Analysis of 2000 Incident Reports , 1993 .

[23]  S. Fidell,et al.  Scaling the annoyance of intrusive sounds , 1981 .

[24]  Emily S. Patterson,et al.  Voice Loops as Coordination Aids in Space Shuttle Mission Control , 1999, Computer Supported Cooperative Work (CSCW).

[25]  Nadine B. Sarter,et al.  Good Vibrations: Tactile Feedback in Support of Attention Allocation and Human-Automation Coordination in Event-Driven Domains , 1999, Hum. Factors.

[26]  Jens Rasmussen,et al.  Cognitive Systems Engineering , 2022 .

[27]  John Paulin Hansen,et al.  An Experimental Investigation of Configural, Digital, and Temporal Information on Process Displays , 1995, Hum. Factors.

[28]  T. Landauer,et al.  Handbook of Human-Computer Interaction , 1997 .

[29]  J. Radcliffe,et al.  The recognition of critical incidents: quantification of monitor effectiveness , 1998, Anaesthesia.

[30]  Penelope M. Sanderson,et al.  Ecological Interface Design for Pasteurizer II: A Process Description of Semantic Mapping , 2002, Hum. Factors.

[31]  Stephen Barrass,et al.  Auditory information design , 1998 .

[32]  Marcus Watson,et al.  Earcon for intermittent information in monitoring environments , 2004 .

[33]  Christian Heath,et al.  Collaboration and controlCrisis management and multimedia technology in London Underground Line Control Rooms , 1992, Computer Supported Cooperative Work (CSCW).

[34]  Marcus Watson,et al.  Work domain analysis for the evaluation of human interaction with anaesthesia alarm systems , 1998, Proceedings 1998 Australasian Computer Human Interaction Conference. OzCHI'98 (Cat. No.98EX234).

[35]  Stephen Barrass,et al.  Using sonification , 1999, Multimedia Systems.

[36]  Marcus Watson,et al.  Tailoring reveals information requirements: the case of anaesthesia alarms , 2004, Interact. Comput..

[37]  K B Bennett,et al.  Graphical Displays: Implications for Divided Attention, Focused Attention, and Problem Solving , 1992, Human factors.

[38]  R. Morris,et al.  Response Times to Visual and Auditory Alarms during Anaesthesia , 1996, Anaesthesia and intensive care.

[39]  Marcus Watson,et al.  Extending Ecological Interface Design to Auditory Displays , 2000 .

[40]  Richard J. Lowell,et al.  Anesthesia, 6th Ed , 1962 .

[41]  Colin F. Mackenzie,et al.  Auditory Alarms: From Alerting to Informing , 2000 .

[42]  Penelope M. Sanderson,et al.  Anesthesia Alarms in Context: An Observational Study , 2001, Hum. Factors.

[43]  Malcolm J. Crocker,et al.  Encyclopedia of Acoustics , 1998 .

[44]  Aldo Cipriano,et al.  An Expert System for Monitor Alarm Integration , 2004, Journal of Clinical Monitoring and Computing.

[45]  R. James,et al.  1000 anaesthetic incidents: experience to date , 2003, Anaesthesia.

[46]  Gregory Kramer,et al.  Auditory Display: Sonification, Audification, And Auditory Interfaces , 1994 .

[47]  David Woods,et al.  The alarm problem and directed attention in dynamic fault management , 1995 .

[48]  Bruce N. Walker,et al.  Ecological Psychoacoustics and Auditory Displays: Hearing, Grouping, and Meaning Making , 2004 .

[49]  Marcus Watson,et al.  Sonification Supports Eyes-Free Respiratory Monitoring and Task Time-Sharing , 2004, Hum. Factors.

[50]  Matthias Rauterberg.  About the importance of auditory alarms during the operation of a plant simulator , 1998, Interact. Comput..

[51]  J. Michael.  Textbook of Medical Physiology , 2005 .

[52]  M J Matjasko,et al.  Hearing Acuity of Anesthesiologists and Alarm Detection , 1994, Anesthesiology.

[53]  D. Notterman,et al.  Adverse Sedation Events in Pediatrics: A Critical Incident Analysis of Contributing Factors , 2000, Pediatrics.

[54]  Bruce N Walker,et al.  Magnitude estimation of conceptual data dimensions for use in sonification. , 2002, Journal of experimental psychology. Applied.

[55]  K. J. Vicente,et al.  Cognitive Work Analysis: Toward Safe, Productive, and Healthy Computer-Based Work , 1999 .

[56]  Robert L. Helmreich,et al.  Team performance in the operating room. , 1994 .

[57]  R. K. Webb,et al.  The Pulse Oximeter: Applications and Limitations—An Analysis of 2000 Incident Reports , 1993 .

[58]  Penelope M. Sanderson,et al.  Work domain analysis and sensors I: principles and simple example , 2002, Int. J. Hum. Comput. Stud..

[59]  S. Selbst,et al.  Adverse Sedation Events in Pediatrics: A Critical Incident Analysis of Contributing Factors , 2000, Pediatrics.

[60]  Stephen Barrass,et al.  SONIFICATION DESIGN PATTERNS , 2003 .

[61]  William W. Gaver.  How Do We Hear in the World?: Explorations in Ecological Acoustics , 1993 .

[62]  Penelope M Sanderson,et al.  Advanced patient monitoring displays: tools for continuous informing. , 2005, Anesthesia and analgesia.

[63]  William W. Gaver,et al.  Chapter 42 – Auditory Interfaces , 1997 .

[64]  George T. Blike,et al.  Specific Elements of a New Hemodynamics Display Improves the Performance of Anesthesiologists , 2004, Journal of Clinical Monitoring and Computing.

[65]  Miguelina Guirao,et al.  Loudness, reciprocality, and partition scales. , 1962 .

[66]  Marcus Watson,et al.  Alarm noise and end-user tailoring: the case for continuous auditory displays , 2000 .

[67]  K. J. Vicente,et al.  The Ecology of Human-Machine Systems II: Mediating 'Direct Perception' in Complex Work Domains , 1990 .

[68]  Günter Rau,et al.  Ergonomic Evaluation of an Ecological Interface and a Profilogram Display for Hemodynamic Monitoring , 1999, Journal of Clinical Monitoring and Computing.

[69]  Marcus Watson,et al.  Visual and auditory attention in patient monitoring: a formative analysis , 2004, Cognition, Technology & Work.

[70]  James L. Szalma,et al.  Effects of Sensory Modality and Task Duration on Performance, Workload, and Stress in Sustained Attention , 2004, Hum. Factors.