A Survey of auditory display in image-guided interventions

PurposeThis article investigates the current state of the art of the use of auditory display in image-guided medical interventions. Auditory display is a means of conveying information using sound, and we review the use of this approach to support navigated interventions. We discuss the benefits and drawbacks of published systems and outline directions for future investigation.MethodsWe undertook a review of scientific articles on the topic of auditory rendering in image-guided intervention. This includes methods for avoidance of risk structures and instrument placement and manipulation. The review did not include auditory display for status monitoring, for instance in anesthesia.ResultsWe identified 15 publications in the course of the search. Most of the literature (60%) investigates the use of auditory display to convey distance of a tracked instrument to an object using proximity or safety margins. The remainder discuss continuous guidance for navigated instrument placement. Four of the articles present clinical evaluations, 11 present laboratory evaluations, and 3 present informal evaluation (2 present both laboratory and clinical evaluations).ConclusionAuditory display is a growing field that has been largely neglected in research in image-guided intervention. Despite benefits of auditory displays reported in both the reviewed literature and non-medical fields, adoption in medicine has been slow. Future challenges include increasing interdisciplinary cooperation with auditory display investigators to develop more meaningful auditory display designs and comprehensive evaluations which target the benefits and drawbacks of auditory display in image guidance.

[1]  Terri L. Bonebright,et al.  Sonific ation Report: Status of the Field and Research Agenda , 2010 .

[2]  Robert J. Webster,et al.  A Telerobotic System for Transnasal Surgery , 2014, IEEE/ASME Transactions on Mechatronics.

[3]  David Black,et al.  Auditory support for resection guidance in navigated liver surgery , 2013, The international journal of medical robotics + computer assisted surgery : MRCAS.

[4]  Derek Brock,et al.  Using an auditory display to manage attention in a dual task, multiscreen environment , 2002 .

[5]  Michael J. Daly,et al.  Augmented Real-Time Navigation with Critical Structure Proximity Alerts for Endoscopic Skull Base Surgery , 2012 .

[6]  Othmar Schimmel,et al.  Auditory displays , 2001 .

[7]  Nassir Navab,et al.  Auditory and Visio-Temporal Distance Coding for 3-Dimensional Perception in Medical Augmented Reality , 2015, 2015 IEEE International Symposium on Mixed and Augmented Reality.

[8]  Makoto Hashizume,et al.  Warning navigation system using real-time safe region monitoring for otologic surgery , 2012, International Journal of Computer Assisted Radiology and Surgery.

[9]  Makoto Hashizume,et al.  A Surgical Navigation System for Guiding Exact Cochleostomy Using Auditory Feedback: A Clinical Feasibility Study , 2014, BioMed research international.

[10]  David Black,et al.  Auditory support for navigated radiofrequency ablation , 2013, CURAC.

[11]  Ronald Azuma,et al.  Augmented-reality visualizations guided by cognition: perceptual heuristics for combining visible and obscured information , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[12]  Sigurd Saue,et al.  A model for interaction in exploratory sonification displays , 2000 .

[13]  Stefan Weber,et al.  Intraoperative image-guided navigation system: development and applicability in 65 patients undergoing liver surgery , 2016, Langenbeck's Archives of Surgery.

[14]  Sandra G. Hart,et al.  Nasa-Task Load Index (NASA-TLX); 20 Years Later , 2006 .

[15]  D. Yuh,et al.  Effect of sensory substitution on suture-manipulation forces for robotic surgical systems. , 2005, The Journal of thoracic and cardiovascular surgery.

[16]  Penelope M Sanderson,et al.  Advanced patient monitoring displays: tools for continuous informing. , 2005, Anesthesia and analgesia.

[17]  J Edworthy,et al.  Improving Auditory Warning Design: Relationship between Warning Sound Parameters and Perceived Urgency , 1991, Human factors.

[18]  Jonathan C Irish,et al.  Localized Intraoperative Virtual Endoscopy (LIVE) for Surgical Guidance in 16 Skull Base Patients , 2015, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[19]  William Buxton,et al.  The use of non-speech audio at the interface , 1988, CHI 1988.

[20]  Dietrich Manzey,et al.  Less is sometimes more: a comparison of distance-control and navigated-control concepts of image-guided navigation support for surgeons , 2015, Ergonomics.

[21]  Christian Hansen,et al.  Touchless interaction with software in interventional radiology and surgery: a systematic literature review , 2017, International Journal of Computer Assisted Radiology and Surgery.

[22]  K Moorthy,et al.  Objective evaluation of the effect of noise on the performance of a complex laparoscopic task. , 2004, Surgery.

[23]  Herke Jan Noordmans,et al.  Auditory feedback during frameless image-guided surgery in a phantom model and initial clinical experience. , 2009, Journal of neurosurgery.

[24]  J. Katz,et al.  Noise in the Operating Room , 2014, Anesthesiology.

[25]  D. Karron,et al.  Surgical navigation using audio feedback. , 1997, Studies in health technology and informatics.

[26]  H. J. Noordmans,et al.  The impact of auditory feedback on neuronavigation , 2005, Acta Neurochirurgica.

[27]  M. Viergever,et al.  Validation of Exposure Visualization and Audible Distance Emission for Navigated Temporal Bone Drilling in Phantoms , 2012, PloS one.

[28]  S. Ahmed,et al.  Influence of music on operation theatre staff , 2011, Journal of anaesthesiology, clinical pharmacology.

[29]  Ron Kikinis,et al.  Auditory feedback to support image-guided medical needle placement , 2017, International Journal of Computer Assisted Radiology and Surgery.

[30]  M. Hofer,et al.  Klinische Erfahrungen mit einem Kollisionswarnsystem , 2010, HNO.

[31]  Richard Kronland-Martinet,et al.  The process of sonification design for guidance tasks , 2015 .

[32]  Richard Kronland-Martinet,et al.  Comparison and Evaluation of Sonification Strategies for Guidance Tasks , 2016, IEEE Transactions on Multimedia.

[33]  T. Mondor,et al.  The perceived urgency of auditory warning alarms used in the hospital operating room is inappropriate , 2003, Canadian journal of anaesthesia = Journal canadien d'anesthesie.

[34]  J Blascovich,et al.  Effects of music on cardiovascular reactivity among surgeons. , 1994, JAMA.

[35]  K. Cleary,et al.  Image-guided interventions: technology review and clinical applications. , 2010, Annual review of biomedical engineering.

[36]  Kristen Wegner,et al.  Surgical navigation system and method using audio feedback , 1998 .

[37]  Maarten M Arnolli,et al.  An overview of systems for CT‐ and MRI‐guided percutaneous needle placement in the thorax and abdomen , 2015, The international journal of medical robotics + computer assisted surgery : MRCAS.