Concepts for augmented reality visualisation to support needle guidance inside the MRI

During MRI-guided interventions, navigation support is often separated from the operating field on displays, which impedes the interpretation of positions and orientations of instruments inside the patient's body as well as hand–eye coordination. To overcome these issues projector-based augmented reality can be used to support needle guidance inside the MRI bore directly in the operating field. The authors present two visualisation concepts for needle navigation aids which were compared in an accuracy and usability study with eight participants, four of whom were experienced radiologists. The results show that both concepts are equally accurate (\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{upgreek} \usepackage{mathrsfs} \setlength{\oddsidemargin}{-69pt} \begin{document} }{}$2.0 \pm 0.6$\end{document}2.0±0.6 and \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{upgreek} \usepackage{mathrsfs} \setlength{\oddsidemargin}{-69pt} \begin{document} }{}$1.7 \pm 0.5\, {\rm mm}$\end{document}1.7±0.5mm), useful and easy to use, with clear visual feedback about the state and success of the needle puncture. For easier clinical applicability, a dynamic projection on moving surfaces and organ movement tracking are needed. For now, tests with patients with respiratory arrest are feasible.

[1]  Stefan Weber,et al.  Evaluation of a portable image overlay projector for the visualisation of surgical navigation data: phantom studies , 2012, International Journal of Computer Assisted Radiology and Surgery.

[2]  D. Louis Collins,et al.  An Evaluation of Depth Enhancing Perceptual Cues for Vascular Volume Visualization in Neurosurgery , 2014, IEEE Transactions on Visualization and Computer Graphics.

[3]  J. Debus,et al.  Projector-based augmented reality for intuitive intraoperative guidance in image-guided 3D interstitial brachytherapy. , 2008, International journal of radiation oncology, biology, physics.

[4]  Gerlig Widmann,et al.  Accuracy and diagnostic yield of CT-guided stereotactic liver biopsy of primary and secondary liver tumors , 2011, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[5]  Arianeb Mehrabi,et al.  Towards markerless navigation for percutaneous needle insertions , 2015, International Journal of Computer Assisted Radiology and Surgery.

[6]  Kai Lawonn,et al.  Improving spatial perception of vascular models using supporting anchors and illustrative visualization , 2017, Comput. Graph..

[7]  Eva Rothgang,et al.  Liver lesion conspicuity during real‐time MR‐guided radiofrequency applicator placement using spoiled gradient echo and balanced steady‐state free precession imaging , 2014, Journal of magnetic resonance imaging : JMRI.

[8]  Nazim Haouchine,et al.  Improving depth perception during surgical augmented reality , 2015, SIGGRAPH Posters.

[9]  Clifford R Weiss,et al.  MR‐guided biopsy: A review of current techniques and applications , 2008, Journal of magnetic resonance imaging : JMRI.

[10]  Ron Kikinis,et al.  Auditory feedback to support image-guided medical needle placement , 2017, International Journal of Computer Assisted Radiology and Surgery.

[11]  Nassir Navab,et al.  Improved interventional X-ray appearance , 2014, 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[12]  Joachim Hornegger,et al.  Rapid freehand MR‐guided percutaneous needle interventions: An image‐based approach to improve workflow and feasibility , 2013, Journal of magnetic resonance imaging : JMRI.

[13]  Ken Masamune,et al.  Image overlay guidance for needle insertion in CT scanner , 2005, IEEE Transactions on Biomedical Engineering.

[14]  Ron Kikinis,et al.  Augmented reality visualization for CT-guided interventions: system description, feasibility, and initial evaluation in an abdominal phantom. , 2006, Radiology.

[15]  Joachim Hornegger,et al.  Percutaneous punctures with MR imaging guidance: comparison between MR imaging-enhanced fluoroscopic guidance and real-time MR Imaging guidance. , 2013, Radiology.

[16]  Lutz-Peter Nolte,et al.  A navigation system for percutaneous needle interventions based on PET/CT images: Design, workflow and error analysis of soft tissue and bone punctures , 2011, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[17]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[18]  Gabor Fichtinger,et al.  Augmented reality visualization with image overlay for MRI-guided intervention: accuracy for lumbar spinal procedures with a 1.5-T MRI system. , 2012, AJR. American journal of roentgenology.

[19]  Nassir Navab,et al.  Contextual Anatomic Mimesis Hybrid In-Situ Visualization Method for Improving Multi-Sensory Depth Perception in Medical Augmented Reality , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[20]  Thomas Kahn,et al.  MRI‐guided procedures in various regions of the body using a robotic assistance system in a closed‐bore scanner: Preliminary clinical experience and limitations , 2010, Journal of magnetic resonance imaging : JMRI.

[21]  G. Strauß,et al.  Image‐guided navigation: the surgeon's perspective on performance consequences and human factors issues , 2009, The international journal of medical robotics + computer assisted surgery : MRCAS.

[22]  Frank Fischbach,et al.  MR-Guided Freehand Biopsy of Liver Lesions With Fast Continuous Imaging Using a 1.0-T Open MRI Scanner: Experience in 50 Patients , 2011, CardioVascular and Interventional Radiology.

[23]  Philippe L. Pereira,et al.  Performing MR-guided biopsies in clinical routine: factors that influence accuracy and procedure time , 2012, European Radiology.

[24]  Thomas Kahn,et al.  Flexible add‐on solution for MR image‐guided interventions in a closed‐bore scanner environment , 2010, Magnetic resonance in medicine.

[25]  Christian Hansen,et al.  Projector‐based augmented reality system for interventional visualization inside MRI scanners , 2018, The international journal of medical robotics + computer assisted surgery : MRCAS.

[26]  Nassir Navab,et al.  Auditory and Visio-Temporal Distance Coding for 3-Dimensional Perception in Medical Augmented Reality , 2015, 2015 IEEE International Symposium on Mixed and Augmented Reality.