Auditory feedback to support image-guided medical needle placement

PurposeDuring medical needle placement using image-guided navigation systems, the clinician must concentrate on a screen. To reduce the clinician’s visual reliance on the screen, this work proposes an auditory feedback method as a stand-alone method or to support visual feedback for placing the navigated medical instrument, in this case a needle.MethodsAn auditory synthesis model using pitch comparison and stereo panning parameter mapping was developed to augment or replace visual feedback for navigated needle placement. In contrast to existing approaches which augment but still require a visual display, this method allows view-free needle placement. An evaluation with 12 novice participants compared both auditory and combined audiovisual feedback against existing visual methods.ResultsUsing combined audiovisual display, participants show similar task completion times and report similar subjective workload and accuracy while viewing the screen less compared to using the conventional visual method. The auditory feedback leads to higher task completion times and subjective workload compared to both combined and visual feedback.ConclusionAudiovisual feedback shows promising results and establishes a basis for applying auditory feedback as a supplement to visual information to other navigated interventions, especially those for which viewing a patient is beneficial or necessary.

[1]  H. J. Noordmans,et al.  The impact of auditory feedback on neuronavigation , 2005, Acta Neurochirurgica.

[2]  Dietrich Manzey,et al.  Less is sometimes more: a comparison of distance-control and navigated-control concepts of image-guided navigation support for surgeons , 2015, Ergonomics.

[3]  Thomas Lange,et al.  Feasibility of Navigated Resection of Liver Tumors Using Multiplanar Visualization of Intraoperative 3-dimensional Ultrasound Data , 2007, Annals of surgery.

[4]  Michael J. Daly,et al.  Surgeons blinded by enhanced navigation: the effect of augmented reality on attention , 2013, Surgical Endoscopy.

[5]  Sandra G. Hart,et al.  Nasa-Task Load Index (NASA-TLX); 20 Years Later , 2006 .

[6]  D. Louis Collins,et al.  DVV: A Taxonomy for Mixed Reality Visualization in Image Guided Surgery , 2012, IEEE Transactions on Visualization and Computer Graphics.

[7]  Horst K. Hahn,et al.  Risk maps for liver surgery , 2013, International Journal of Computer Assisted Radiology and Surgery.

[8]  Herke Jan Noordmans,et al.  Auditory feedback during frameless image-guided surgery in a phantom model and initial clinical experience. , 2009, Journal of neurosurgery.

[9]  Frank Fischbach,et al.  MR-Guided Freehand Biopsy of Liver Lesions With Fast Continuous Imaging Using a 1.0-T Open MRI Scanner: Experience in 50 Patients , 2011, CardioVascular and Interventional Radiology.

[10]  Jonathan C Irish,et al.  Localized Intraoperative Virtual Endoscopy (LIVE) for Surgical Guidance in 16 Skull Base Patients , 2015, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[11]  Thomas Hermann,et al.  TAXONOMY AND DEFINITIONS FOR SONIFICATION AND AUDITORY DISPLAY , 2008 .

[12]  S Puckette Miller,et al.  Pure Data : another integrated computer music environment , 1996 .

[13]  William Buxton,et al.  The use of non-speech audio at the interface , 1988, CHI 1988.

[14]  Heinz-Otto Peitgen,et al.  Illustrative visualization of 3D planning models for augmented reality in liver surgery , 2010, International Journal of Computer Assisted Radiology and Surgery.

[15]  Jonathan C Irish,et al.  The effect of augmented real‐time image guidance on task workload during endoscopic sinus surgery , 2012, International forum of allergy & rhinology.

[16]  Ali Momeni,et al.  OpenSound Control: State of the Art 2003 , 2003, NIME.

[17]  David Black,et al.  Auditory support for resection guidance in navigated liver surgery , 2013, The international journal of medical robotics + computer assisted surgery : MRCAS.

[18]  Michael J. Daly,et al.  Augmented Real-Time Navigation with Critical Structure Proximity Alerts for Endoscopic Skull Base Surgery , 2012 .

[19]  M. Viergever,et al.  Validation of Exposure Visualization and Audible Distance Emission for Navigated Temporal Bone Drilling in Phantoms , 2012, PloS one.

[20]  Maarten M Arnolli,et al.  An overview of systems for CT‐ and MRI‐guided percutaneous needle placement in the thorax and abdomen , 2015, The international journal of medical robotics + computer assisted surgery : MRCAS.

[21]  Guang-Zhong Yang,et al.  Comparative effectiveness and safety of image guidance systems in neurosurgery: a preclinical randomized study. , 2015, Journal of neurosurgery.

[22]  Logan W. Clements,et al.  Concepts and Preliminary Data Toward the Realization of Image-guided Liver Surgery , 2007, Journal of Gastrointestinal Surgery.

[23]  D B Karron,et al.  Audio-guided blind biopsy needle placement. , 1998, Studies in health technology and informatics.

[24]  Matthew Wright,et al.  Open SoundControl: A New Protocol for Communicating with Sound Synthesizers , 1997, ICMC.

[25]  Stefan Weber,et al.  Computer-assisted liver surgery: clinical applications and technological trends. , 2012, Critical reviews in biomedical engineering.

[26]  Marcelo M. Wanderley Proceedings of the 2003 conference on New interfaces for musical expression , 2003 .

[27]  Makoto Hashizume,et al.  Warning navigation system using real-time safe region monitoring for otologic surgery , 2012, International Journal of Computer Assisted Radiology and Surgery.

[28]  Lejing Wang,et al.  Precise X-ray and video overlay for augmented reality fluoroscopy , 2012, International Journal of Computer Assisted Radiology and Surgery.